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0 . Quality assurance in in-house continuing 
training - case studies from Europe 



0.1 Preliminazy remcurks on the institutionalization and 
course of the project 

In many Iteoiber States of the European Union, an intensive 
debate has been in progress for some years with regard to 
quality management and quality assurance in vocational 
and in-house continuing training. With the rapid quanti- 
tative growth of the continuing training sector, and the 
new strategic importance of continuing vocational train- 
ing for social and economic progress in the Member 
States, questions about the quality of continuing train- 
ing have become of prime importance. These questions are 
no longer of interest only to vocational instructors but 
also concern training and social policy. 

The Europecui Cconmission' s Task Force Human Resources 
[TEHR] is following with keen attention the debate about 
the quality of continuing training in the Member States. 
In the European FORCE and EUROTECNET p r o g r am mes, too, 
there are a number of projects concerned with quality 
assurance conc^ts in continuing in-house and vocational 
training. 

It must be said, however, that although the debate on 
quality assurance in in-house continuing training is 
being conducted in parallel in the Member States of the 
European Union, no interchange of ideas is taking place 
between them. This separation is only partially attribut- 
able to the different structures of the continuing 
training systems, more so to the absence of technical 
transfer opportiinities . 
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The Idea of an intensive stvidy of questions relating to 
quality assurance In continuing vocational training was 
bom In 1993 as a Franco- German Initiative, out of the 
"German- French Continuing Training Dialogue" sponsored by 
the European Cosnnlsslon In Lyons and Stuttgart. The 
peurtlclpants In these conferences, recruited mainly from 
projects forming peurt of the FORCE and EOROTECNET pro- 
grammes, produced, among other things, a draft proposal 
on the study and fiurther development of approaches to 
quality assiurance In the sector of continuing vocational 
(and especlcilly In-house) training. The Idea behind this 
was that such approaches may contribute to a general 
improvement In the quality of continuing training In 
Europe. As a consequence of the draft project, the 
representatives of the French and German governments on 
the "FORCE/EUROTECNET Advisory Ccannlttee" Introduced In 
1994 an Initiative to establish a "Working Peurty on 
Quality Assiurance" . The Working Peurty was attached to the 
FORCE programne and was organized and managed by the Task 
Force Human Resources. As matters progressed, partlculeur 
efforts were nede - In conjvinctlon with the representa- 
tives of the European Ccaimlsslon's Task Force Human 
Resources - by Mr Pierre Le Doucuron of the French 
Ministry for Labour and Employment, Mr Georges Klntzele 
representing the TFHR, and Mr Dieter Lellmann of the 
German Federal Ministry for Education, Science, Research 
and Technology to produce a feasible concept of the 
project Idea. After the project outline had been pre- 
sented In the FORCE/EUROTECNEn^ Advisory Ccmmittee, It was 
decided to set ip a steering group to cover this project, 
mcuie \p of the Interested members of the Comnlttee, vdio 
would guide and monitor the progress of the project. The 
Member States Involved In the study appointed national 
experts to be responsible for data acquisition and the 
prepcuratlon of studies on quality assurance In continuing 
training In their respective national contexts. Acting as 
an expert committee, they were also to provide technical 
suggestions and expert reports to help determine the 
objectives of the European stuidy. The representatives of 



the social partners were represented both on the steering 
committee of the FORCE/EOROTECNErr Advisory Ocaxonittee and 
on the project expert: group. Particularly at the planning 
phase of the project, their suggestions made many valu- 
able contributions to the suibseguent inplementation. A 
nuoiber of sittings of the steering ccmnittee of the 
Advisory Ccmnittee defined the objectives of the project 
and prepared specifications on that basis to formulate 
thft work to be done by the national experts and the 
German/French project tea m s. 

Two fundamental constraints on the project mandate are 
significant: 

1. The suibject of the stuc^ is to be "Quality assurance 
in continuing vocational training in and/or for 
firms" - vdiere external training providers are 
described. 

2. The remit of the project is to eiscertain the current 
state of quality eissurance in work and, on the basis 
of the apparent trends, problems and opportunities 
for continuing training, to derive options for fur- 
ther activities by the Task Force Human Resources. 

These terms of reference in themselves make it clear that 
the national experts are of central importance in the 
acquisition and documentation of cases and e3q>erience in 
their respective Member States. Within a veiry tight time 
frame, they were to make available data and assessments 
which, although they did not have to purport to be 
repi:esentative in the statistical sense, were neverthe- 
less to give a reliable impression of the current situa- 
tion and trends in quality eissurance in continuing 
training for the European obseirver. 

Within the steering committee and the expert group, it 
was rapidly agreed that the best method for obtaining 
access to the specific procedures and problems of firms 



in this area \«as by way of case stTidies. The price 
consciously paid for the advantages of a qualitative case 
stvidy was that, at the end of the day, the databcise would 
consist of a variegated meiss of ccnpletely different 
cases, \dilch would make cosnpeuratlve analysis more diffi- 
cult. Standard proposals for the methodological design 
and subdivision of the national studies were intended to 
ensxire their ccmpcurablllty without Imposing any restric- 
tions on freedom as far as content and weighting were 
concerned. 

Since quality assurance in continuing training Is still 
a relatively new area for the majority of firms and 
training providers in Europe, It was decided from the 
outset that no attenpt should be made to obtain reports 
on the "average" firm or training provider. Tb this 
extent, the Ccises now available do not provide a repre- 
sentative sanple of data on the status of the Implementa- 
tion of quality assurance In continuing training for 
European firms aa a vdiole. They do, however, provide a 
very good representation of the current state of quality 
assurance In continuing training for Innovative firms and 
training providers vdio are already active In this field. 
More on this In due course. 

Each of the national studies contains from three to five 
llltistratlve cases of quality assurance by firms or for 
firms. The presentation of the Ccises Is confined to 
actually effective mechanisms and methods of quality 
assurance In continuing training. Although reference Is 
also made to methods in the pleuinlng. or preparatory 
stcige, the report as a vdiole deals with the actual state 
of quality assurance. 

In the presentation of the cases, their Intrinsic mode of 
action and their specific framework conditions are 
followed. They are not treated with reference to 
standardizing external stanc^lnts. The resxilt Is to 
ensure that the objectives actiially existing in each case 
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as regards quality assurance are taken into account. 

All the national studies are stiructiired on the following 
lines: 

- introductiaai Status and classification of the selected 
cases. Genered. remarks on the national context of 
quality ass\irance in continuing training. 

> Cases illuatrating the application of quality ass\urance 
methods to in-house continuing training and vocational 
training in institutions. 

* Outlook: Assessment and evaluation by the national 
rapporteur on the further development of quality 
assinrance in continuing training in the country \inder 
report. 

The breakdown of the description within the individual 
case studies largely follows an optional catalogue 
presented in the "Specification for the national atock- 
takea" by the Technical Project Management": 



1. 


Presentation of the case study per se 


1.1 


Vlhat are the objectives of quality assurance? 




□ 


Interests of mcuiagement, enployees, instructors, 
trainees, etc. 




□ 


Criteria of the success/benefit of continuing 
tredning and its quantifiability 




□ 


Adaptation of what has been leeumt to practical 
working conditions 




□ 


Increased enployment, ccoopetitiveness, etc. 


1.2 


Vlhat methods of quality assurance eure applied? 




□ 


Ix^nit evaluation, output evaluation, process 
evaluation 




□ 


Others 
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1.3 What methods of qu8d.ity assurance eu:« applied? 

□ Observation in the working situation 

□ Measurement of acc^tance 

□ Pcurticipant survey 

□ Tests based on lecuoiing objectives, escamination 
evaluation 

□ Feedback on the user situation (interaction 
between the working world euid contintiing training) 

□ Self - evaluation 

□ Others 

1.3 What can be said about the effectiveness of quality 

assurance in the case described? 

□ Effects on firms 

□ Effects on eniployees 

□ Effects on training providers 

□ Other effects 

2. ^iplications of the caae described aa regards continuing 
training in general euid the continuing training mcurket 

□ Relationship between customer euid service provider 

□ Evolution of the continuing training supply 

□ Ccopetition between providers of continuing treuning 

□ etc. 

3. How do questions relating to the certification of qucd.ity 
euid the standardization of quality standards play a pcurt 
in continuing training in the case described? 

□ ISO standards, natioocdL steuidards 

□ Standards applied by providers euid firms, other 
stcmdards 

4. To vAiat extent can idesis, experiences and 
standardizations from the general quality eussurance 
movement be euic^ted to continuing training in the caaa 
described? 



The effect of the free choice of Institutions and/or 
firms described in the case stiidies is that the cases 
cannot be representative, so that no general, espirical 
statements can be derived from them. 'Iliey do however 
give an impression of the real mode of action of quality 
assurance methods in continuing vocational training, 
and provide indications as to current debates in the 
respective Member States, possible innovative trends anH 
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possible developments at national and European level. 

Over and above the case descriptions/ the authors of the 
national studies provided expert assessments on fiirther 
develoFBnents, problems and projects vdiich are irportant 
for the field of quality assiirance in continuing 
vocational training. 

This smanarizing report collates essential findings from 
the nine national studies, and tries to identify joint 
starting points and problems in quality assiirance in 
continuing vocational and in-house training in the Member 
States concemed. 

It thus pursues a dual objective: 

• First, it documents and compares the quality assiirance 
methods used in continuing in-house training in the 
peurticipating countries with reference to eopirical 
cases, as a way of helping to irprove the transparency 
of continuing training systems. 

• Secondly, it performs some initial preparatory work for 
the transfer of inteimationally usable quality assiur- 
ance methods in continuing in-house training, vdiich may 
serve to irprove the ccaipatibility of continuing 
training services in Europe. 



0.2 Quality assurance projects in the European 
Union's training programnes 

The theme of izxproved quality and quality management in 
connection with questions of continuing training has also 
been taken in the European Union's progr a mmes in 
recent years . 

In addition to the case studies, therefore, e^q>erience 
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and material on the siibject of the investigation were 
also available from the three Ccninunity progranmes 
CXSMEIT, EUROTECNET and FORCE. These show that quality 
assiurance ideas in continuing training also play a pcurt 
in previous projects under the European programne. 
Experience and starting points are already available here 
to serve as a basis for futiure activities. 

- OGMETT refers to its activities in the field of produc- 
ing guidelines for uoproving the quality of various 
training measures . For exanple, "Aguaibrce" repiresents 
an approach to quality assiurance in university engin- 
eering courses, based on the EN ISO 9000 series of 
standards. "Saturn" is a quality guideline for home 
stucfy courses or for "open" learning systems. The theme 
of quality cissiurance in training was discussed at a 
CGMETIT conference in Antwerp. A guideline for cooper- 
ation between universities and firms is to appecu: ixi 
1995 as a follow-i:^ activity. 

- FORCE, too, can point to relevant experience at project 
level. This relates primarily to projects dealing with 
the relationship between Tbtal Quality Sfeinagmitent [T^S] 
and the EN ISO 9000 certification of firms and their 
innovations in the continuing tredning sector. Simi- 
larly, the theme of quality cissurance and continuing 
training in the FORCE sector studies has a part to 
play. The stucfy on "Contractued. Policy" Ccunried out 
under the auspices of FORCE also touches ijpon the theme 
of quality assiurance in continuing tredning. The new 
forms of employee peurticipation in the workplace, 
including involvement in the management of continuing 
training, and the questions of socied. partnership they 
encompass are also central questions of quality eissur- 
ance in continuing training. 

~ The EUROTECNET progranme includes projects in vdiich 
questions of evaluation in continuing training are a 
central line of developnent. As in the case of FORCE, 
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there are many projects v^ch deal with the relation- 
ship between innovative business organization/ and 
the resxilting needs in continuing training. A number of 
publications have also dealt with questions of evalu- 
ation and quality assurance in in-house continuing 
training. 

By way of conclusion to the previous work done by the 
TFHR in the area in question, reference may be made to a 
quality guideline on the prepcuration of materials for 
home stTidy courses, based on TQgA and drawn vp by the 
association of European hcaaoe stu<^ institutions [AECS] 
with the cooperation of the European Union's TFHR. 



0.3 Data situation and a few general assessments of 
the res\ilts of the field work 

Following the coanpletion of the field work, nine studies 
are available from the following Member States: 



Belgium 


[BF] 


Gezmany 


[D] 


France 


[F] 


Greece 


[GR] 


Ireland 


[IRL] 


Luxembourg 


[L] 


Portugal 


[P] 


Spain 


[E] 


United Kingdom 


[UK] 



The cases presented in the stvidies are in the form of a 
variegated mixture, corresponding to the various national 
systems, problem sitiiations, objectives and focal points 
in continuing vocational training. 

The subjects of the cases are: 

* Firms (both large and small businesses from a wide 
O 
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variety of industries) 



* Providers of continuing vocational training (private 
and public training providers) 

* Associations (euployer associations, industry associ- 
ations, associations of training providers, etc.) . 

Objectives and approaches in quality assiirance also 

differ widely between the various cases. 

* In many cases, quality assurance in continuous training 
is described as systematic planning and in-house imple- 
mentation of continuing training. In other words, the 
objective is to integrate continuing training into 
strategic company aims and their implementation. The 
overall process, ranging from training needs analysis 
through planning and implementation of continuing 
training measiires to evaluation, is restructured from 
quality aspects. This sector of in-house training 
management is encountered in many of the cases 
described. 

* In some cases the preparation of a specification on the 
overall process of continuing in-house training, on the 
part of the training provider or on individual 
measTires, is described as an example of quality assur- 
ance in continuing training. In these cases, the speci- 
fication serves as an instrimnent of systematic in-house 
training management, or as a market- structuring instru- 
ment for a list of requirements to be met by external 
training providers. 

* Quality assurance in continuing training is presented 
in some of the in-house cases as "training controll- 
ing" , in other words eis an attempt to improve the 
economy of continuing training activities. 

- In other cases the evaluation of a specific continuing 



training measure is presented as an approach to quality 
assurance. 

- For soane cases in the private training provider sector, 
quality assurance is tinders tood as a "marketing 
measure" . 

- Th& aspect of consumer protection of those with a need 
for continuing training (individuals or fizms) is the 
focus of soeone cases of governmental intervention into 
quality assiurance in continuing training. 

^le pliurality of objectives, approaches euid areas of 
activity of quality assiurance in continuing training also 
makes it clear that the case studies frcm the Member 
States are largely pilot projects and model undertakings 
idiich, to date, are by no means representative in them- 
selves of continuing training systems or for all European 
enterprises . 

On the other hand, a high degree of convezgence and a 
niTmihft-r of overlaps eUld parallels exist both within the 
various cases and in the e 3 q)ert opinions on general lines 
of development and the problem areas of quality assurance 
in continuing training. 



0.4 General development trends in the Ceises con- 
sidered; general assessments by the national 
experts 

In all Member States, there is a clear trend towards 
propagating and generalizing quality assurance in con- 
tinuing training in its various fields of application. 

Although many of the exanples are pilot projects, idiich 
play a prepeuratory role in the Member States, it is clear 
that the introduction and processing of quality assurance 
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systeaons in continuing training are beccsning more import- 
ant both to firms and to training providers: 

* The firms are increcisingly recognizing the continuing 
training of their eaplayeea as being an investment in 
human resources. In conjunction with the awareness of 
the increasing strategic importance of human resources 
potential for the ccnpetitiveness of businesses, the 
question of quality assurance in the continuing train- 
ing sector is acquiring a ccnpletely new significance. 
Continuing training, in all its facets, is becoming a 
critical factor for a firm's success, in terms of both 
cost and benefit. Correspondingly, effozrts to optimize 
quality assurance are becconing of greater and greater 
interest for all firms. 



However, the experts also report that in those com- 
panies \diich have not hitherto greisped the fact that 
continuing training is a vital factor for their 
success, the concept of qucQity assurance in continuing 
training is, naturally, also an unfami liar idea. In 
these cases, making the firms aware of the situation is 
a precondition for everything that follows. 




Ihe various efforts made firms in recent years to 
ensure the quality of their products, aervicea and 
internal procedures necessarily lead on, in a second 
stage, to considerations of qucQity assurance in 
continxiing training. Irrespective of vdiether firms are 
certified under the EN ISO 9000 series of standards or 
under other national standards, as regarxis the quality 
of their business procedures, or \diether they aim to 
implement Total Quality Management [TQ^ methods, 
individual employees and their continuing training 
always play a central role in modem procedures to 
improve operational qucQity. In mcuny of the cases 
presented from the Member States, therefore, it becomes 
clear that companies have been made aware of the signi- 
ficance of quality assurance in continuing training 
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certification of general procedures and structxires 
under the EtT ISO 9000 series. Since the need to obtain 
certification affects an ever-increasing number of 
firms (directly, as sv^liers to firms \diich have 
alrecuSy been certified, or indirectly through market 
processes) , such sensitization processes may be 
expected to increase fiirther, with consequences both 
for the content and for the quality assurance of 
in-house continuing training. 

- J\nother boost to the increasing importance of quality 
assurance in continuing training has been provided by 
gavenment legislative initiatives to protect the 
consumer in continuing training. This aspect beccmes 
apparent in seme of the case studies from the Member 
States . To sv^lement market mechanisms in the continu- 
ing tredning market, seme of the Member States are 
trying, by way of laws and regulations, to strengthen 
the position of customers for continxiing training 
(w he ther they be individuals or firms) as against those 
siq^lying it. Hiese attempts, too, reflect the desire 
to increase the overall quality of continuing voca- 
tional training, to improve market transparency and to 
offer customers for continuing training a degree of 
security vdien purchasing continuing training services. 

- It is appeurent from many of the cases described that, 
and how, quality assurance in continuing training is 
increasingly perceived by the external providers as the 
effect of pressure from the firms requesting it. Even 
the more traditional operators in the provision of 
continuing training are being forced by increasingly 
specific requirements from the firms to introduce 
customer-oriented services \diich result in new service 
procedures and, overall, require their activities to be 
subjected to more intensive quality assurance measvires 
\diich are more transparent for the client. Mere market- 
ing promises about "tailor-made continuing training" 
are no longer sufficient. Well-informed finxus are 
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increasingly demanding individually designed ccntinTiing 
training services. This demand does not only relate to 
the implementation of the training measvures. Their 
adaptation to particulcu: operational needs requires 
both preli m i nar y services (needs analyses, designing of 
innovative contents and methods) and follow-\]p methods 
of evaliiating the effects and efficiency of the train- 
ing measure in question. In the interests of succeeding 
in the market place, training providers will have to 
resort to ^propriate quality assurance measures, to 
the extent of obtaining certification for their vdiole 
organization . 

These trends toweurds the spread of quality assurance in 
continiiing vocational training in Europe find expression 
in different fonas. The cases described frcm the Member 
States exhibit, here again, a ccpprehensive spectrum of 
different phenomena. The following forms cure mentioned 
repeatedly: 

* Quality assurance in continuing training is incorpor- 
ated as strategic integration of continuing vocational 
training into all targeting and planning procedures 
within the firm. Continuing training is regard ed as an 
investment and optimized by appropriate quality assiur- 
ance procedures. 

* Other cases describe systematic planning and implemen- 
tation procedures for continuing training in the firm 
as quality assurance. Continuing training manajgmftn h or 
"I'ingenierie de la formation" [training engineering] 
would be the conc^ts for this procedure. 

* In connection with the two preceding forms, or indepen- 
dently of them, the preparation of specifications for 
the implementation of continuing t rainin g are descr i baH 
as quality assurance in continuing training. Th es e 
specifications relate in part to internal training 
events, but they cure also drawn up by the firms as 
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specifications for training providers. 

- In other cases "training controlling" is treated as a 
form of quality assurance in continuing training. The 
main eophasis here is on questions of making continuing 
training more efficient and eccncmical . It constitutes 
an attenpt to quantify the costs and benefits of 
continxiing vocational training in monetcury terms, 
analogously to other operating factors, and to optimize 
them accordingly. 

* In various cases, the aspect of employee participation 
at all levels of the continuing training process plays 
a central part in quality assurance in continuing 
vocational training. On the same lines as recent models 
of TQ^, the primary eo^diasis is on direct participation 
and involvement for all those concerned in the training 
process . 

* In most cases, eix{diasis is laid on the fact that an 
essenticQ. criterion of quality assurance in continuing 
training comprises successfully transferring what has 
been learnt to the workplace. Accordingly, the efforts 
made revolve euround optimizing this transfer. 

* In a few Ccuses, quality assurance centres on the 
question of the evaluation of continuing training in 
its various aspects. In these cases, attention is paid 
to evaluation criteria, parameters, methods and instru- 
ments . 

* Some cases are characterized by the efforts of the 
firms or training providers to obtain a certificate of 
successful quality assurance for their continuing 
training activities. In line with standards laid down 
externally (national requirements, EN ISO 9000 et seq, 
etc.), efforts at quality assurance are aimed at 
meeting these standards and carrying out appropriate 
audits. 
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The illustrative cases in the national studies also 
describe in detail a nisnber of other foxms of quality 
assurance/ and a great many ccmbinations of the forms 
listed above. 

The fact that the collection of cases relating to quality 
assurance in continuing training is so dispeurate natur- 
ally raises questions of how the term should be defined. 
What is certedn is that, in present-day continuing 
training practice, very different procedures and concepts 
are subsTimed under quality assurance. 

This has two consequences for our further procedure: 

1. The present stocktake is more representative of cases 
of quality i i r p ro v ement in continuing training than, in 
the naonxwer sense, cases of specific quality 
assurance or the evaluation of vocational tredning 
content . 

2. On the other hand, the stocktedce reflects the fact 
that continuing training practice, for both firms and 
training providers, is initially concerned with 
developing suitable approaches to quality assurance. 
This means that it may be premature to adsq>t, 
xinthinkingly, a quality assiurance concept from 
production sectors to continuing training; there is 
still developnent work to be done here. 

Even as regards the present situation of continuing 
training in Europe, the national experts believe that 
inportant effects are being produced by the existing 
approaches to quality assurance. 

* Even today, quality assurance methods are bringing 
about a nuniber of innovations in continuing training. 
These innovations relate to the organization of the 
further training (enployee participation, systematic 
planning, etc . ) , they relate to continuing training 



methods (job-related forms of learning, coaching, self- 
teaching, etc.) and they relate to the content of the 
further training (social ccmpetences, multiskill 
aspects, etc.). 

* Even today, the approaches to quality assurance In con- 
tinuing training are resxiltlng In changes in the con- 
tinuing training market. The external training pro- 
viders are Increasingly being forced to offer customer- 
oriented services, and tailor-made service for firms 
and Individual participants Is Increasingly becoming a 
reality. 

- Even today, again, there are signs of rationalization 
of the continuing training economy^ Firms perceive 
continuing training as an Investment vdiose cost/benefit 
ratio has to be optimized. The continuing training 
personnel are creating systems for their ovm vrork and 
trying to find cost-effective solutions. Professional- 
ization of continuing training Is resulting In the 
Identification of continuing training services and the 
corresponding prices. 

* Conpanles are Increasingly recognizing the systematic 
xise of continuing eonployee training as a competitive 
necessity. 

- There Is a growing demand for specific offers of 
certification In the sector of. continuing training 
quality assxirance. In the long term, training providers 
In many Member States will be \jnable to escape certifi- 
cation procedures \mder external quality standards If 
they hope to become established In the market. Both 
In-house continuing training departments and, especi- 
ally, the private and seme of the public training 
providers are Increasingly striving for ways of demon- 
strating the quality of their products, their processes 
and their organization as a \diole. Both nerketlng 
aspects and attempts to iixprove Internal effectiveness 
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0.5 



List and rough cleissification of the cases 



0.5.1 List and cleissification by Member States 

In an initial overview, the case studies can be classi- 
fied as follows by countries of origin and institutions 
providing the continuing training: 



Member State 


Firms 


Public 

providers 


Private 

providers 


Association 
of firms 


Association 
of providers 


Others 


TbtaJ by 
States 


Belgixsn (Flemish) 


2 


3 


1 


1 


. 


. 


7 


Germany 




2 


. 




1 


2 


5 


France 


4 


1 


1 


. 


_ 


_ 


6 


Greece 


2 


1 


1 


1 




_ 


5 


Ireland 


4 




. 


_ 






4 


lAncenbourg 


2 


1 


1 


_ 


. 




4 


Portugal 


2 


1 


1 


1 


1 


. 


6 


£fpain 


2 


1 


. 


1 


1 


1 


6 


feed Kingdom 


3 


1 


_ 


_ 


. 


_ 


4 


TbtaZ by providers 


21 


11 


5 


4 


3 


3 


47 



However, the allocation of the cases to the categories 

shown must be relativized as follows: 

* In many cases, more than one institution is involved - 
for exanple, one firm and one training provider. As a 
rule, these cases were classified as designated by the 
national experts. 

* The different national contexts provide differing 
functional splits in the public provider sector. For 
example, in soone Meniber States the government labour 
agencies are also providers of training, vhile in 
others they are not, etc . . 

- Associations act as training providers in some cases, 
^diereas in others they act merely as bodies providing 
quality assurance in continuing training. 





Nevertheless/ even this quite approximate classification 
makes it clear that . . . 

- we have Ccise studies covering different subjects of 
quality cissurance/ and 

- in the light of their national backgrounds, the experts 
have chosen different focedL points in describing the 
cases . 



0.5.2 The firms as the subject of the case descriptions 

In classifying the cases by size of enterprise and by 
sector (N.A.C.E) we find: 



# 


Sector 


Large enterprise 


SMS 


8.2 


Chemical raw materialB 


3 


_ 


8.3 


Metal vrorUjig 


4 


1 


8.4 


Processing (non-metallic) 


- 


5 


8.5 


Construction 


1 


_ 


8.7 


Transport/ comnunlcaticn 


1 




8.8 


Banking, finance 


1 


_ 


8.9 


Services 


1 


4 




3l>tal 


11 


10 



In those cases where enterprises \diich are not tredning 
providers appecu: as subjects of quality assiirance in 
continuing training, there is a virtually even break 
between large enterprises and the small and medi\mi-size 
enterprises [SMEs] . This, of course, is ceirtainly not 
attributable to the fact that SMEs cure particularly 
active in the sector of quality assiirance in continuing 
training - the reverse being true. The e3q>erts tried to 
inclxjde these SME Ccises in order to highlight the specicdL 
featiures of quality assiirance in continuing training for 
small enterprises, ^le distribution of the enterprises 
over the sectors merely suggests that the subject of 
quality assiurance in continuing training is included in 
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all sectors. 



0.5.3 The tredniiig providers as the subject of case 
descriptions 

When the training facilities described in the case 
studies are classified by the provision of training by 
the respective institution, the picture is as follows: 



Type of training institution 


Number of cases 


GovemzDent training providers 


9 


Training providers from associations of enterprises 


5 


Private training providers 


3 


Associations of training providers 


2 


Training providers of enployer associations 


1 


Union training providers 


1 



* All nine studies provide documentation of quality 
assxirance in continuing training vdiich is undertaken by 
government or government -controlled institutions in the 
continuing training sector. It can be assumed that in 
most cases the government departments function simul- 
taneously as customers, training providers and a 
monitoring authority for continuing training. In some 
cases, however, they appecu: in only one of these 
capacities. 

* Cases \diich seem particularly interesting are the five 
in vdiich training providers are pursuing their efforts 
to provide quality assxurance in continuing vocational 
training as representatives of an association of 
enterprises. Four of these providers are pursuing a 
sectoral approach (they originate from an industry 
association of companies) , \diile one is concerned 
specifically with SMEs. 

- Quality assxurance as an initiative of an association of 





training providers can be conceived as an impetus to 
professionalization and self -monitoring in the continu- 
ing training sector. 



0.4.4 Thematic foccLL points of the case descriptions 

With reference to the requirements led.d down by the 
steering group of the FORCE/EOROTECNET Advisory Com- 
mittee, Chapters 1 to 4 of the present report deal with 
the analytical focal points of the stxidy by referring to 
the contributions made by the various cases. Since some 
of the analytical focal points run transversely to the 
case descriptions, clear allocations are possible only in 
a very few cases. Cases vdiich, for example, deal with the 
mancigement of continuing training in a large enterprise 
simultaneously contain descriptions of joint projects 
with external training providers, offer indications of 
changes in the continuing training market and improve- 
ments to be achieved in continuing vocational training, 
etc. 

Similcurly, the following breakdown includes multiple 
mentions of the cases reported: 



Cases from: 


Eater- 

prises 


Pro- 

viders 


Others 


Quality management of in-house 
continuing training 


20 


14 


2 


Quality assurance in 
cooperation between firms and 
providers 


21 


26 


13 


Quality assurance emd 
structuring of the continuing 
training market 


11 


15 


14 


Quality assurance and irproved 
quality in continuing 
vocational training 


21 


11 


10 



In particular, the focal points "market development" and 
"improved continuing training" naturally depend primarily 
on the expert's comments on the cases. This also means 



that the assessmesits stsid final amlyses of these es^^erts 
are incorporated into the chapters concerned. 

The case studies treat quality assurance in all thematic 
focal areas as an integrated element of the organization 
and iinplementation of continuing training^ not as a 
separate, iaposed procedure. Tb this extent, it is clear 
that the cases are considering the aspect of quality 
assurance in continuing vocational training, and not 
quality evaluation methods as such. 
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Ic Quality assura^e axsd quality staziagi^smt of in-bouse 




1 . 0 Prelimiiiazy remarks 

Continuing in-house training in the Heniber States of the 
European Union has achieved unprecedented dimensions. It 
is an essential factor in the attraction of Europe as a 
location for business activities. The development and 
application of modem quality management and quality 
assurance methods in continuing in-house training, 
however, have not kept pace with this expansion. Existing 
initial approaches to a systematic evaluation and quality 
assurance in continuing in-house training are at odds 
with their immense cost and increased importance. 

Only recently did Europe embark on an intensive dis- 
cussion of quality management and success evaluation in 
continuing in-house training, the monitoring of training 
and the organizational framework conditions for quality 
assurance. In this discussion, quality management is no 
longer understood as quality control of individual 
training methods but as a global concept acccoxpanying the 
process, incl\jding ascertainment of needs and planning in 
the preliminary stage together with the evaluation of the 
practical implementation of the training syllabus . The 
important role attributed by the case studies frcm the 
nine Meniber States to the application of ISO Standards 
9000 et seq. for the quality management of continuing 
in-house training is reflected by this new perception. 

The description \diich follows summarizes case studies on 
quality assurance in continuing in-house training at and 
by firms. It therefore relates primarily to those cases 
from the national studies \diich include continuing 
training measures or strategies directly implemented by 
firms or commissioned 1:^ them, and not those cases 
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relating to continuing vocational training in government 
or public facilities. Cases which deal with the special 
features of joint efforts by ccopanies and extesmal 
training providers are discussed in [Chapter 2] . 



The discussion is based on the following individual Ccise 
studies by firms: 



0 


Itame 


Cbuntxy 


Sector 


Hbrk force 


CT Dapt. 


DX4 


Bays Chemical Distributioo 
Ltd 


Phi tad Kingdom 


Qiemlcal 


SMSs 


yea 


B3 


O.ZNI-TBMBQ 


Spain 


Association of public 
enterprises 




yea 


UKl 


Bowles Outdoor Centre 


united Kingdom 


Outdoor education 


16 


no 


ZRU 


? 


Ireland 


Fbod processing 


32 


no 


73 


Raymond Oeoffray 


France 


Preserves 


36 


no 


72 


CSLZT- Prance 


France 


Industrial filters 


50 


no 


UK3 


Walker Financial Solution 
Ltd. 


Kingdom 


DP system bouse 


80 


yes 


ZRL4 


? 


Ireland 


Health care products 


U3 


yes 


P5 


Coopers t Lybrand 


Portugal 




378 


no/yes 


DK2 


Cleveland Antmlanca NHS 
Trust 


Kingdom 


Anbulance Service 


396 


no 


1X03 


? 


Ireland 


Printing and paper 


335 


yea 


ZX03 


? 




Food producer 


370 


yes 


L4 


Du Pont da Nemours 


Luxentxairg 


Qiemical 


1,270 


yea 


BFl 


ATBA NV. 


Belgium (FI.) 


cation technology 


1,500 


yea 


GR2 


Blefsis Shipyards S.A. 


Greece 


Shipbuilding 


2,000 


yes 


Pi 


Renault Portugal 


Portugal 


Car Industry 


2,300 


yea 


LI 


ARBBD 


Luxenft)ouzg 


Metal- production 


8,000 


yea 


B4 


Dragados y Construcciones 
S.A. 


Spain 


Building 


U,000 


yea 


GR3 


Bank of Qreece 


Qreece 




14,000 


yea 


FI 


SQLLAC 


France 


Iron smelting, 
metallurgy 


20,000 


yea 


B5 


Telfonica en Bspagne S.A. 


Spain 


Teleecinnml cations 


73,000 


_yes 



In addition, it ed.so relates to a nuniber of Ccise studies 
of certifying organizations or training providers \dio 
work in close conjunction with an enterprise. The status 
of quality assxirance in continiiing in-house training 
the application of ISO EN 9000 et seq. , as documented in 
many cases, in explained in a separate digression [cf. 
Chapter E] . 

It should be noted, however, that featxires in coannon 
between the case studies of continuing in-house training 
do not justify an assunption that the same featxures exist 
in the majority of European firms. As a result of the 
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procedure used to select the firms of the case studies - 
the intention being to describe exanples of effective 
quality assurance - the presentation is restricted to 
firms active in continuing training. Thus all those 
described in the British study have received a national 
quality award and attribute their market success to the 
intensity of their continuing training measures. The two 
large Greek enterprises dealt with in the case studies 
cure considered in Greece as pioneers of systematic 
in-house training. In the Luxembourg stiidy, reference is 
expressly made to the innovative part played by the 
cases. Etc. However, the fact that the firms presented in 
the case stiidies are largely described as picmeers in 
their field of innovative models of continuing in-house 
training at least expresses a need \diich is also regarded 
as existing for those firms vdiich have not hitherto 
systematiced.ly planned or evaluated training. But beca\ise 
the cases are neither representative nor described in the 
light of uniform criteria, this summarizing study cannot 
permit itself to engage in any quantitative coaipeurison or 
draw any concliisions about the statiis of quality 
assurance across the spectrum of the firms. This stuc^ 
reflects an impression of objectives, organization, 
methods cOid instruments of quality assurance in continu- 
ing in-house training. In particular, it will show in 
\diich areas the requirements to be met by quality manage- 
ment and quality assurance in continuing in-house train- 
ing cure identical throughout many European States. 



1.1 Oontinuing training as a business investment 

In the national studies on quality assurance in continu- 
ing in-house training, it is consistently reported that 
the firms' attitiides to the continuing training of their 
employees have changed. 



In a number of case stxidies vdiich specifically relate to 



in-house qualification meastires/ and also in a nuniber of 
other case studies \diose siibject is the interaction of 
training providers and finoos, the following attitvides axe 
described: 

* continuing in-house training is regarded ^ an essen- 
tial means for achieving the firm's econcmic objec- 
tives, and no longer primarily as a social service or 
benefit for the workforce. 

* Accordingly, it is not provided or bought in eis a 
peripheral service but integrated into the strategic 
business plan and so designed to suit the individual 
firm, 

* and the bcunriers formerly existing between the produc- 
tion and qualification processes are tending to come 
down: work and leeuming cure more closely interlinked; 
greater iaportance is being attached to continuity of 
leeuniing in line with a constantly changing production 
process. Qualification is no longer determined on 
technical grounds alone but relates to the production 
process as a vdiole: "transverse qualification", "globcU. 
continuing tredning", "h^rid qualification" are key 
£dirases characterizing this viewpoint. 

In brief: continuing ecployee training is regarded in 
many of the European firms described in the case studies 
as an essential investment to secure competitiveness and 
is planned and evaluated accordingly. 
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This concept is explicitly expressed as being a nati onal goal o£ training policy 
in British study by the \ise of the term "investors in people". The gov- 
ernment various industrial associations adopted a joint progranme vhereby 
50% of medium-sized to large enterprises will, by 1996, be recognized by ixide- 
pendent auditors as "investors in people". This recognition requires the firms 
to link their business objectives closely to the continuing tra in i n g and per- 
sonal development of their employees and to plan and evaluate their in-house 
continuing training systematically [UK] . 

As the Irish study summarizes it: "A common theme runs through all case studies. 
It is that the development of staff pl\is increased employee involvement and 
customer focus in all aspects of business is the key to quality and 
competitiveness. ... The value of training and the tra in i n g function as a tool 
for conpetitiveness is constantly underlined in this study." The study refers in 
particnilar to the role of continuing training as a "change agent" within the 
firm [IRL] . 

This attitude to continuing training is also encountered in small enterprises 
such as CELIT-France : "Training expendlttire thus r^resented only 0.6% of the 
wages bill. Since 1987, training has been perceived as a fully fledged invest- 
ment, and the corresponding expenditure is now about 5%, following peak years in 
Mfhich it rose to 9% (1988, 1989) of the wages bill." [F3] (cf. also [FI] and 
[F3] ) . 

In discussing the ARBED and Du Pont cases, the Luxeaibourg stud^ offers the 
following sxmmary: 

"In both cases described, the needs to be met derive from translating the 
enterprises' operational and strategic objectives into action plans calling for 
clearly defined qualifications and so generating an approach vAiereby the excist - 
ing qualifications are adapted to the taxrget qualifications through Individ- 
\xalized training plans. In the two selected enterprises, the approach adopted 
conprises a precise definition of the ^jectives to be achieved by tra in i n g , 
developing a continuous monitoring system during the implementation of the 
programme and, subsequently, assessing the results achieved. In both cases, 
training is clearly defined as an investment and those responsible for tra in i n g 
act as training consultants" [LI, L4] . This, however, is not in line with the 
status of quality assurance in the majority of firms in Luxcenbouxpg, where the 
strategic Importance of continuing txraining is frequently ixnrecognized as yet. 

As regaxcds Dragados y Construcciones , Pedro Coxrdova in the Spanish study main- 
tains: "The outlook has now broadened. In accoxrdance with the principles of 
Total Quality, Txraining to be planned like any other pxroductlon pirocess, and 
it is necessciry for a system of evaluation to be oxrganized for each stage, after 
the needs have been identified, until the acquired knowledge is applied in the 
workplace. The evaluation has to be planned and applied at eveiry stage of a 
process. This makes it possible to maintain permanent monitoring of the tra in i n g 
process and its results and to ensure its quality" [E3] (cf. also [E2] ) . 



To vAiat ^tent practical consequences arise from this new 
concept of the role of continuing in-house training, 
v^ch can be identified in virt\ially all case studies of 
firms, seems to depend partly on general framework 
conditions of ^-r aining and economic policy, but partly 
directly on the size of the firms. 
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* The documented cases freon large firms all show evidence 
of systematic planning and evaluation of training; to 
scone extent/ undertaking this task is actually the 
primary function of an in-house tredning system, ^diile 
the carrying-out of continuing training is delegated to 
specialist departments or exteimal providers. 

■ Snail and mediun-sized enterprises, by contrast, 
operate their continuing training on more of an 
informal basis and in the light of short-term defini- 
tions of needs. If the sample of the case studies is 
followed, it is only in exceptioned. cases and ^>ecif ic 
sectors with high quedification requireonents (data 
processing [UK3] , business consultancy [P5] , medical 
services [UK2] } that continuing training is pre-planned 
and evaluated in a more systematic manner. 



1.2 The objectives of quality assurance in in-house 
continuing training 

The effect of regeuixiing continuing in-house tredning aa 
an investment is that many Cc^e studies deed, with system- 
atic planning of in-house training aa a contribution to 
quality assinrance in continuing training. An essentied. 
criterion for quality in continuing tredning is regarded 
here as integration into strategic operating objectives 
and their implementation. Tredning management in the firm 
is described end assessed, in these cenes, from econcanic 
and business strategy quality standpoints. 

In these cases, the focus is not on the individued. 
training meeusinre and its quality but on the organization 
and course of continuing in-house training as a whole, 
proceeding from the determination end analysis of 
through conc^t development to implementation 
evaluation. 
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A ccamioa featiire of these cases lies in the fact that 
quality assurcoice relates ^ primarily ^ not to the content, 
theory or methods of the continuing tredning measxires but 
to their function for the overall strategy of the enter- 
prise. Quality standards in teaching apply not per se but 
indirectly: in the assessment of the efficiency of the 
continuing training in terms of the firm's success. 



The Bowlea Outdoor Centre, United Kingdom, formally offered only travel and 
outdoor recreation. The centre has now switched Its products to management 
qualification schemes combined with outdoor esqperlence. The decisive strategic 
factor behind the reorientation of the centre was the continuing training of the 
16 employees. The overriding criterion of quality assurance In continuing 
training, therefore, was how far and at ^diat speed the product switch took place 
[UKl] . 

Walker Financial Solutions Ltd., a DP systems house In the Uhl ted Kingdom, 
pursues essential objectives of company strategy through the continuing training 
of Its employees. They include I s p r o v lng employee motivation, reducing staff 
turnover, and adapting the workforce to the rapid pace of technological change. 
The eval\iatlon of continuing training Is thus directly associated with the 
recording of business management parameters such as individual productivity or 
the turnover rate [UK3] . 

Quality assxirance at Elefsis Shipyards S,A. , Greece, "Is absolutely determined 
by the Interests of the enterprise towards the growth of Its productivity and 
the strengthening of Its competitiveness as well as toward the minimization of 
the work accidents" [GR2] . 

In the French metal energy groi:q> 5QLLAC, planned restructuring measures and an 
attempt to laprove the economics of continuing training were the factors that 
led to the desire for quality assurance [FI] . 

At ARBED In Luxembourg', the decentralization of spectral analysis Is the objec- 
tive of quality assurance In continuing training: "The case analysed relates to 
a training programne organized following the decentralization of the spectral 
analysis activity In the various production centres. The existing 'spectral 
analyses' department has been reduced to a nucleus of Individuals ytho. In 
particular, supervise the correct use of the spectroanalysls technology In the 
various production centres. The decentralization of this activity forms part of 
a general policy of restructuring and product-based decentralization at ARBED, 
and the approach to training Is In direct line with the general continuing 
training procedure developed by ARBED In 1993, and In accordance with ISO 9000" 
ILI] . 

A medium- sized Irish food producer measures the results of continuing training 
"through changes In the departanental output, coat, defect rates, absenteeism, 
turnover, productivity rates and a wide level of evidence In cultural change" 
[IRL2] . 



There are many possible teurget categories in continuing 
in-house training: for example the satisfaction or 





learning success of participants, the irprovement of 
instructional methods and media, the optimization of 
training costs, ensuring successful practical transfer or 
changes to organization structures. In the cases docu- 
mented, most of the objectives mentioned are those 
directly related to the economic success of the firms: 

* measurement of the success of continuing training \diich 
can be calculated in Ccush terms 

- cost reduction in continuing training 

- quality assurance of the end product or service, reject 
reduction 

- mcdcing in-house procedures more effective and iap r o v ing 
internal communication 

’ mcurketing relations with custoaners 

' measuring the increase in the individual productivity 
of the workforce 0^ ensuring know-how transfer, better 
motivation, lower turnover, better working envirossoent, 
etc. ) 

' selection of external training providers and improving 
their services 

Conversely, the achievement of these objectives - though 
it may depend on a number of other factors - is regarded 
as an important indicator of the quality of continuing 
in-house training. 

Certification of quality management luider the EN ISO 9000 
series of standards is used in many case stiidies eus a 
teurget parameter for the in-house trcdning system too. In 
addition, the descriptions devote extensive space to 
business management procedures \diich atteopt to eussess 
continuing training in cost/benefit terms. By contreust. 
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teaching- related or learning-psychology aiethods of 
evaluation are mentioned - if at all - only as a 
prerequisite for an economic assessment. 



1.3 Quality ass\irance by systeanatic planning of continu- 
ing training 

Continuing in-house training ccoprises mozre than just the 
organizing of courses. A large nuniber of essential 
preparatory and follow-\:^> activities also have to be 
regarded as part of continuing training, although these 
activities are often less defined and independently 
ozganized than the actual training measures . Accordingly, 
a perc^tion of quality assiurance in continuing in-house 
training \diich is reduced to mere evaluation of instruc- 
tion falls short of \diat is necessary. Quality assiurance 
in continuing training is only effective if it 
encconpasses all phases of the training process, starting 
with the initial planning and continuing through to the 
application of ^lat has been lecumt. 

The following starting points for quality assurance in 
continuing training can be distinguished: 



If the elements of quality assurance in all cases of 
continuing in-house training are broken down and eunranged 
in a sequential relationship, the result is a control 
loop of quality assurance in continuing in-house train- 
ing. In some cases, individual elements are enphasized to 
different extents - vdiich may be because of the cases 
themselves or because of the weighting given in the 
presentation; but quality assurance is always designed as 
a continuously effective process and not as a specific 
measure. 
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1. Quality assxorance in continuing training is not only 
concezned with optimizing the actual training 
measvires. In the preparatory period, quality assxir- 
ance in continuing in-house training includes, in 
particular, questions of training needs analysis. In 
many of the cases documented, cooperative models of 
needs analysis are \ised: in these cases, potential 
participants and/or executives are brought in even at 
this early stage (explicitly in FI, F2, F3, IRL: all, 
LI, L4, PI, UK: all) . 

2. In the conception of continuing tredning measvires, 
great importance attaches to adaptation to special 
in-house needs . Quality assvirance in continuing 
in-house training is a medivim for this adaptation. In 
these Ccises there are signs of a trend away frcm 
standard courses towards "tailor-made" seminars and 
forms of workplace-based continuing training. 
In-house technical and management staff often help to 
plan the structvire of training measures. This takes 
account of in-house conditions and the financial and 
human resources available to the firms (explicitly in 
Fl, F2 , F3 , I!RL* all, PI, P2, UKl, XJK4) . 

3 . In some of the cases described, the isplementation of 
the continuing training measvires is s\]bjected to an 
on-going assessment, for example in the form of 
s\:pervi s ion of instruction or occasional siirveys of 
lectvirers or participants. In the majority of cases, 
quality assvirance is based on the results of evalu- 
ations at the end of the implementation ^diase. The 
practical transfer of \diat has been learnt is in many 
cases the focal point of an assessment of in-house 
continuing training. In seme cases, not only the 
continuing training but also the final assessment 
takes place within the working process. In these 
cases, the purpose of the assessment is to relate 





contents and methods as closely as possible to the 
requirements of particular jobs. 

4. In scane cases, the optimization of continuing train- 
ing on the basis of the results of the training 
demand analysis and the assessment is described as an 
independent £diase of the continuing training organiz- 
ation, \diile in others it is incidental. New 
standards for the planning, design axid implementation 
of ftirther continuing training measures are derived 
frcm the results of the assessment, and implemented. 
In many cases, however, optimization relates not only 
to the training meastnres themselves: questions are 
often asked about the contribution made by quality 
asstnrance in continuing training to the development 
of the firm's workforce and organization. Therefore, 
particular attention is also devoted in the case 
stxidies to the organizational aspects of continuing 
in-house training, and consideration is given to how 
the planning and evaluation of training are linked to 
the mcuiagement of the firm. 

1.4 Those involved in quality assurance in in-house 
continuing training 

The fizms described in the case studies have a training 
depcurtment of their own and/or cooperate with external 
training providers [cf. in this connection C!hapter 2] . 

In its relationship to the firm's other units, an 
in-house training department is traditionally seen in 
terms of an internal but separate provider of courses: 
the continuing training department receives reports on 
training needs from the technical and production depart- 
ments, and designs appropriate courses vdrLch are given by 
its own or external lecttirers and attended by partici- 
pants of their own volition or as a result of being 
selected by their sijperiors. To this extent, the internal 
training department is regarded by the techniccLl and 
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prcxiuction departments eU3 similar to an external tredjiing 
provider. 



The National Banfc of Greece S.A. malnfcAlna a "training division, that system- 
atically develops and ijipleiiients continuing vocational training activities for 
its personnel" . The planning and evaluation of training are largely a matter for 
the t ra'**^^^'>g management [GR3] • 

Blefaia Shipyards S.A. also has its own separate training department, vdilch is 
responsible "for the planning and the implementation of In'ccnpany training and 
continuing vocational training activities that carry out mainly through its 
technical training centre [sic] " . The continuing training is planned without any 
direct Influence by the technical departments on the in-house training system 
[GR2] . 

The French iron smelting group SQLLAC has a personnel department of its own in 
vdiich the plans for continuing training of employees are worked out. Ihis, too, 
is \diere decisions are taken on ^diether to carry out the training measures in 
house or to buy them in from external providers [FI] . 

The French motor gro\:p Renault is described as a case in \diich the central 
continuing training department is increasingly delegating its powers to the 
group's works, \diere the various departments now plan continuing training, carry 
it out or buy it in on a decentralized basis. Central personnel development 
sxjpports this process by providing specifications, etc. [F4] . 

The Innovation is described in very similar terms at the Luxembourg steel pro- 
ducer ARBED. Central personnel development supports and advises the departments, 
vhich Independently determine the demand for training and arrange s\iltable 
meas\ires [LI] . 



Quality assurance in continuing in-bouse training is 

arranged in these cases by various in-house actors i in 
the majority of cases it is initiated and implemented by 
the training and personnel departments themselves, \diile 
in some cases this is done by the management of the firm 
and in rcure cases by the pcurticipants ' s\q>eriors or by 
the peurticipants themselves. 

- Quality assessment by the in-house training department 
generally leads to the results being reflected directly 
- and therefore quickly - in quality i m provements to 
the continuing training measiures. It is also possible 
to infer from the instruments and methods used for 
assessment in the corresponding case studies that the 
enphasis is on work-related criteria. But the organiz- 
ation of in-house training work separately from produc- 



tion also brings specific difficulties for quality 
assuTcuice in continuing training: although instruction 
may be assessed in the internal sector of the tr a i nin g 
department, quality assiurance can hardly extend as far 
as t-hft application of the loiowledge and the actual 
jobs. So although questions can be asked on reproduc- 
ible syllabuses at the end of courses, the transfer of 
the qualifications to the irking process remains 
largely iinconsidered. The evaluation of courses is 
largely excluded from the determination of this practi- 
cal transfer; how knowledge is applied at the workplace 
after the completion of a course is generally outside 
its horizon. Consequently, it is generally conclxided 
from the learning success or satisfaction of the 
participants - in other words from the v&cifiable 
reproduction of the content of the courses by the 
participants or frxam participant surveys on the course 
- that application of vdiat has been learnt in 
vocational practice will probably be successful. 



The organizational identity of those responsible for iityleinentation and quality 
in continuing training permits or encourages, in some cases, a relatively 
informal basis for quality assurance: "The effectiveness of the used tra in i n g 
evaluation activities and their impacts on the quality iji^provement of the 
developed and implemented training are being appraised by the tra in i n g manage- 
ment on an informal basis” [GR2] • ^le situation at the National Bank of Greece 
SA is very similar: here again the Training Division has sole responsibility for 
quality assurance matters, and the bank too has "not yet established an inte- 
cprated formal operational system for the quality assurance of its training 
activities” [GR3] . 



• One aspect of quality assurance by management is that 
it is not jxist the individual training measure that is 
reviewed but, incidently as it were, the fvinctioning of 
the entire training department. Another is that there 
is more emphasis on criteria of ccnpany strategy and 
economics: in many cases, continuing in-house training 
is indirectly measured in terms of secondary effects on 
productivity and profit, and other business management 
parameters. By contrast, there is less emphasis on 
intervention based on the content and style of train- 
ing. 
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- Quality assurance in continuing training by the super- 
visors of the participants ensdiasizes, in most of the 
documented cases, the successful transfer into practice 
of vdiat has been learnt in the training measures; 
however, it is not always a sijiple matter to guarantee 
that the results produce a feedback effect in the 
sepeurate training department. In addition, in the 
process of evaliiation within in-house hierarchical 
structvures, questions of quality assvurance in continu- 
ing training may become confiised with questions relat- 
ing to individual assessment of personnel, or personnel 
selection. In these cases, the pax^icipation of lectvu:- 
ers and participants in continuing training is, 
natvurally, often neglected. The reliability of the 
assessment and the effectiveness of subsequent quality 
assvurance measvures may suffer from possible overlaps 
with internal conflicts of interest. 

- In some of the cases, self-evaluation by the peurtici- 
pants was encouraged as the starting point for quality 
assvurance in continuing in-house training. In these 
instances, the participants' opinion influences the 
quality assvurance process through evaliiation instru- 
ments such as participant questionnaires or quality 
discussions between pcurticipants and lectvurers [cf. 
Section 1.3.1] . However, in none of the documented 
cases are the participants in training measures 
directly involved in decisions regarding 
optimization of quality in continuing training. This 
seems striking, especially in those in-house continuing 
training programmes vdiich purport to promote 
independence and sense of responsibility of the peirti- 
cipants yet, for quality assurance purposes, prefer 
methods of outside control to self-assessment 
ind^endent activity by the participants. Ultimately, 
it can be assumed that the participants in ri ontimi'i nq 
training are themselves best placed to jxidge the 
utility of a qualification for their working activ- 
ities . 
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A notable exception is the case o£ Du Pont de Nemours from Luxeznbourgr. The 
company endeavours to reduce formalized quality assurance processes at all 
levels and. Instead, to strengthen the enployees' independent sense of respons- 
ibility. Independent discipline is encouraged, rather than inposed discipline. 

The same applies to processes of optimization in continuing training [L4] . 

Most of the documented cases are hybrid forms . For 
exanple, methods of participant self-assessment are often 
ccaxibined vdth assessment by the training department, or 
decision makers frcm other in-house depcurt men ts 
(Personnel, Oontrollizig) cure balanced against results of 
assessment within the training system. 



Walker Financial Solutions Ltd. , Gtaited Kingdom, integrates the personnel 
assessment, \diich talces place regularly every three months, into the conti n ui n g 
training eval\iatlon: "Following the training or developanent activity the manager 
anri individual or groip meet to assess whether the objectives have been 
achieved. Subsequent performance is assessed through observation by the indivi- 
dual's line manager self evalxiatlon. All esployees have a performance review 
every three months based on measurable objectives. During the reviews an evalu- 
ation takes place to establish the degree of business benefit achieved through 
previous training or development activities. Eval\iatlon results are recorded on 
enployee training records and areas for iaprovement are noted. " The documenta- 
tion of the case does not reveal bow reliable a self-eval\iatlon is idiich is 
directly linked to external assessments in the internal hierarchy [DK3] . 

This also applies to other SMBs. In the French case of Raymond Geo f fray, the 
eval\iation of continuing training is a problem child. Apart from measurements of 
j-Yktk degree of acceptance during the actual continuing training measure, the m a in 
approach conprises Informal, personal inquiries by the owner: "Khat have you 
learnt?" etc. In the specific case of SMBs this kind of direct coimunication, 
bacJced up by other self-assessment methods, may be a way of solving the evalu- 
ation problem, if the owner is sufficiently well briefed on sxich matters [F3] . 

Pena n 7 r In Jf^tugaZ hae a cooplete arsenal of evaluation methods. Elements of 
self-assessment are selectively combined with observations by siqperlors and 
studies by external esqperts. Evaluation covers both the measure Itself and its 
transfer into practical application [PI] . 

The case of tha Spanish coopany Dragados y Cons trucci ones is conparable. In this 
case, particular weight attaches to the eval\iatlon of the learning process 
itself [E4] . 




- 47 - 



49 



1.5 Quality assurance in practical application 

The question of the practical relevance of continuing 
training curises on the basis of the separation of the 
sphere of continuing training frcm the pursuit of a 
profession. This separation makes it possible to struc- 
tiure the continuing training in accordance with didactic 
criteria rather than merely productivity-oriented ones. 
It does, however, involve the risk that the contents and 
methods of in-house continuing training may becoene remote 
from the gued.ification requirements of the working world. 
Ensuring that the results of qualification measinres cure 
suitable for practiced, application is, therefore, the 
essential core of quality cissurance in in-house 
contin\iing tredning. ^le successful transfer of \diat has 
been leeumt into practice is, in the documented cases, 
the essential (^lality featinre of in-house continuing 
training. 

In most cases, what is assessed is not only how the 
content of the courses has been absorbed 1:^ the trednee 
but, in paxticuleu:, how it can be implemented with regeurd 
to working requirements. Training concepts cure optimized 
1:^ recording the transfer into practice: they eu:^ 

designed so that they relate to specific practiced, 
problems, expanded to include treatment of matters \diich 
curise not frcm the systematics of the syllabus but frcm 
its implementation, and tightened so that nothing is 
leeumt except what is specificcd.ly necesscu:y at the 
workplace. The intention is that the workplace, through 
the continuing training eissesament, should directly 
regulate the training concepts and ensiure that technical 
course material precisely suits the requirements. 
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In the British case study particular stress in laid on the fact that the 
certification of vocational training under the National Vocational Training 
System (NVQ) takes place largely through tests conducted directly at the 
workplace or in practical simulations/ and, conversely/ optimization of the 
training measiires is derived from this. Thus the Cleveland Ambulance SHS Trust 
provided continuing training for its ambulance personnel as paramedics in order 
to inprove the speed and quality of the first aid provided to the patients. The 
f Inal two znodul es of the continuing training co\ir s e are taught on - the -job/ 
certified by observation of the participants/ and Imnediately evaluated for 
retroactive quality assurance of continuing training. 

Blefsis Shipyards S,A. , a Greek shipbuilding conpany, bases quality assurance in 
the continuing training of its production workers directly on "systematic 
observations at the wor]q>lace/ using a suitable/ structured observation grid”. 
Methods and contents of continuing training are modified in the light of the 
recorded results of the practical transfer. 

Telefonica in Spain tries to evaluate the practical transfer as part of its 
"overall result evalxiation” / in \dilch the effects of continuing training on 
attitudes/ skills and practical changes in work performance are stxidied. 
Questionnaires for former participants and supervisors are used. Direct observ- 
ation by management is the essential procedure [E5] . 

Renault Portugal attaches particular importance to workplace observation by 
supervisors in order to evaluate the effects of continuing training . This is 
supplemented by occasional effect studies carried out by external specialists 
[PI] . 

For SMEs too, the practical application of vAiat has been learnt is naturally of 
central interest in evalxiating the continuing training. CELXT-France tries to 
assess these effects two to three months after the conpletion of the training 
meas\u:e/ the eval\iation methods still being in need of fxirther development [F2] . 



In same case studies. In particular stress is laid on the 
fact that the £im in question hcus been certified under 
ISO EN 9000 standard series: the formalized quality 
management and quality assurance in the firm as a \diole 
is also linked to an ongoing evaluation of the qualifica- 
tions and training of the workforce with regartl to the 
requirements of their jobs. This provides, in particular, 
indications of quality problems with transferring the 
resxilts of in-house continuing training into practice 
[for fxirther details, c£. Chapter E] . 

Scone of the in-house quality eissurance conc^ts presented 
assume that an evaluation of continuing training froon the 
stand^int of practical transfer alone does not conform 
to the functions \diich modem conc^ts of industrial work 
organization cissign to in-house training activities. 
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These concepts are no longer concerned with nurturing the 
image of the euplcyee as being technically cooipetent to 
meet certain specific requirements of his job, favouring 
an image vdiereby the enployee masters varying tasks, 
works and learns independently, and not only complies 
with instructions \diich have been laid down but also 
participates in planning his work and monitoring its 
results . 

However obvious it may seem to evaluate in-house 
continuing training primarily with regeurd to the 
practical transfer of the knowledge gained, this 
stanc^)oint can greatly shorten the assessment. Ihe basis 
for eval\iating the quality of continuing training is 
individucd. productivity in pcurticuleu: working activities 
- but si;ppose these activities change, so that knowledge 
has to be transferred independently to meet other 
requirements? The quality of in-house continuing training 
is demonstrated not only by the ability to meet current 
technical requirements but also by its flexibility. This, 
however, is difficult to observe in specific practical 
application. Over and above technical qualification, 
in-house continuing training is cd.so esq)ected to hxpcurb 
cannpetencies: certain social and methodological 

prequalifications are to be encouraged, naturedly cLLong- 
side continuing vocational training. It is specifically 
a form of in-house continuing tredning ^diich does not 
exclude the social and oirganizational context of working 
activities from the training process that seems suitable, 
to many people, to irpart sxich transverse qued.if ications . 
Yet an evaluation \diich reviews only the practiced, 
application of technical knowledge fails to meet this 
objective. This form of evaliiation is confined to assess- 
ing ^>ecific learning and working perfozmcuice. 
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Elefsis ShipyardB S,A, , Greece, mentions, in a d dition to technical qualification 
objectives, even at the level of "lower and middle ranked technical personnel" a 
number of transverse qualifications vAiich in-house continuing tra inin g is 
Intended to promote: "adaptability to modified processes and forms of work", 
"reinforcement of the personal interest in and satisfaction by the work", etc. 
[6R2] . 

At ATEA N. V . , Belgium, it is assumed that continuing training and personal 
develqpment must promote "autodidactic skills" among the workforce and not have 
an exclusively technical purpose, so that a cozqplex and flexible produc- 
tion process is able to function: encouraging management and readiness to obtain 
qualifications independently [BFl] • 

In all the Irish cases, reference is made to demand for transverse qualifica- 
tions: e.g.: "Management require staff to take on board more responsibility, i.e. 
adjust the production machinery as required" [IRLl] , "Inp r ovement and In^rtance 
of teamwork" [IRL2] , "Raising workers' sense of their role and responsibility in 
an enterprise" [IRL3] . 

The decentralization of spectral analysis is isposlng various requirements on 
workers at ARBED Luxembourg, including versatility, flexibility and willingness 
to take responsibility [LI] . Du Aant de Nemours, again in Luxembourg, is basing 
its CGoqplete innovation strategy on the Independent responsibility and Initiative 
of its enployees, including - and specifically - in connection with optimization 
and Innovation processes [L4] . 

Coopers anH Lybrand in Portugal want their continuing training activities to 
strengthen, in particular, the potential of their employees to adapt, ^ley 
eyal\iate this by measurizig changes in performance in various fields of the firm* s 
activities (work, product, firm as a whole) [P5] . 



1.6 Quality assurance by monitoring of training 

Because of the economic situation and organizational 
changes, the training departments in many fizms are being 
required to justify their existence in a way \diich did 
not previously happen. To the extent \diich their perform- 
ance ];:^CG 0 iies integrated in the firms' economic planning, 
they are losing their special role. They are no longer 
Ccunried as "xu^roductive depcurtments" but have to demon- 
strate a cost-benefit ratio in business management 
categories. The ccaxprehensive term covering such economic 
quality assurance methods is justified "training 
controlling" . 

The classification of in-house training departments as 
"cost centres", \diich "sell" their services to other 
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departments in the firm ccxticezned/ makes them ccopcurable 
\inder varioois headings^ incltidlng economic ones, with 
external providers . One possible consequence of the 
results of training controlling is the outsourcing of 
training services to external suppliers, vdrLle another is 
that training departments vdrLch previously pxx>vided only 
internal services may enter the meurketplace as providers 
of training to third parties. 

Not all the cases concerned with in-house continuing 
training report on processes vdrLch have been developed 
for training controlling. 



The studies on the Spanish ccavpanies Dragados y Construccionea anrf Telefonica 
represent an exception. Here, training controlling In the strict economic sense 
is an Integral part o£ quality assurance in continuing training [E4, E5] . The 
Spanish study on G,INI~TESBQ documents an attenpt to carry out quality assurance 
in continuing training entirely with reference to quantitative (cost) parameters. 
Training controlling is carried out radically in this case [E3] . 



It can however be assumed that all firms \diich maintain 
in-house training departments use at least informal 
methods of training controlling - even if only in the 
budgeting of these depcurtments and the assessment of 
their value by the decision makers , Miere the cases 
include instructions for training controlling in the 
strict sense, these are rarely ccnplied with: there are 
few reports of cost/benefit evaliiation methods . It can be 
asserted, however, that all the enterprises described in 
the case studies are concerned, to a greater or lesser 
extent, with the question of \diether their in-house 
continuing training pays its way. 



The Jrish case stuc^ reports that training controlling represents a prerequisite 
for adequate investment in continuing training: "The need to evaluate the results 
of training and the bottom line costs of providing training are creating a 
pressure to make training more accountable . Without sinple cost effective 
instriiments many trainers resist the challenge to measure the results of their 
efforts. The spend on training in ccnpanies needs to be increased to 
competitiveness, but many ccnpanies resist spending in this area beca\ise they are 
unsure of the return on their investment. Good evaluation tools will help 
trainers develop prograxnnes that yield the results required, determine the costs 
of training and development, calculate the return on investment, get more 

management support for training and development" [IRL] . 
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A fimdamentcJ. problem of training controlling/ and one 
vAiich also been documented in many cases outside the 
present case studies/ is that the cost of training 
measures can be ascertained relatively simply/^ but not 
all the benefit can be demonstrated under econcmic 
headings. In this situation/ training controlling methods 
resort to the introduction of "benefit indicators" , vdiich 
for their part are not as inaccessible to business 
management evaluation as the qualifications of the 
workforce (cf. EA) , but are determined or at least 
affected by qualification processes. However zealously 
such indicators are used/ as a consequence of the 
practical need for ced.culability/ the fact remains that 
it cannot be assxmoed that i m provements in the quality of 
r nnh-irm-ing training are reliably expressed in these 
indicators. In many of the cases / therefore/ in the 
efforts to improve quality/ the cost-effectiveness of 
continuing training is regarded more as a maxim than as 
a precisely quantifiable yardstick. 



1.7 Quality assurance in innovative in-house forms of 
lecLcning 

Although the traditional course of continuing training 
still plays the central role in most cases / there are 
also reports of many new forms of in-house continuing 
training designed to integrate the obtaining of qualifi- 
cations more closely into the working process: they 

inclxxde on-the-job learning [F2/ LI/ lA, Pi, UK: all] / 
works visits [UKl] / project team learning [IRLl/ IR3] , 
presentations by external e3q>erts [IRLl/ UKl] / and the 
obtaining of qualifications by ST5>ervision by colleagues 



^ Thi s at least applies to the direct costs of in-house 
continuing training. In the cost calculation/ areas 
of uncertainty necessarily arise yiben, over and above 
the direct costs / an atteopt is also made to deter- 
mine the indirect costs (such as the costs of m a ki n g 
personnel available) and the opportunity costs. 
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[UK4] or by coaching [BFl] , and fozins of on-the-job self- 
qualification with open learning and CBT materials [BFl, 
IR2, IRS, UK4] . Ihe role of the training department 
changes accordingly: "It changes from trainer to 
facilitator (broker) in the field of transfer of 
knowledge/e:q>erience/infoiixiation" [BFl] . 

This variety of locations and forms for internal leeuming 
has repercussions on quality assurance in in-house con- 
tinuing training. Its basis can no longer be confined to 
the conventional evaluation of instruction. To the extent 
that in-house training and the working process cure linked 
by new forms of learning, it is necessairy to go beyond 
the actual teaching processes to analyse specific 
properties of the surrounding oirganization, if statements 
cure to be made regeurding possible i m pro v ements in con- 
tinuing training. The quality of in-house continuing 
training depends on the "corporate cultmre", the openness 
of the environment and, in brief, on the recdization of 
a "lecuming organization". 

Freon this angle, the evaluation of in-house continuing 
training has the function of arresting structural and 
organizationally caused obstacles to learning and provid- 
ing advice on the removal of such obstacles. It thus 
plays its part in the realization of new concepts of 
corporate organization. It is clecur that such didactic 
intervention in the operational organization pres\:^]poses 
intensive cooperation, and perhaps even the integration 
of production and training depeurtments within the firms. 
The separation hitherto custcenary proves obstructive if 
the evaluation of continuing training is to have horizons 
beyond actual qualification: questions of work organiz- 
ation, the techniccd. design of workplaces, performance 
measiurement and remuneration ceirtcdnly have a part to 
play in the effectiveness of in-house continuing fcr- ain - 
ing. Although these factors can probably only be changed 
to a limited extent from the stanc^int of optronizing 
continuing training, it is nevertheless regsurded as 



indispensable in scane case stiidies that their specific 
effects should be made visible - if only to adapt quali- 
fication in the individual case to the conditions of an 
environment \diich is determined by economics rather than 
didactics . 

On working through the case enterprise stiidies, however, 
it is notable that, as a ^diole, little attention is paid 
to this possibility that quality assxnrance in in-house 
training will have a retroactive effect on the organiz- 
ation of the enterprise - at least, there are few reports 
to that effect. In virtxially all Ceises, the individual 
training measiure and the preparatory and follow-i:^ 
activities are regarded as the only changing variables of 
quality management. 

The case stiidies present several exa&ples in \diich the 
conventional separation of continuing training and 
production is partly eliminated, for example by the use 
of in-house technical exper1:s and practitioners aa 
lecturers, by autodidactic materials for production 
employees, the transfer of lecuming locations into the 
working process, or organizational integration. 



At ATEA N.Vw a producer of teleccmnunicatlons products in (Flemish) Belgium, 
technical production experts are used as lecturers In In-house continuing 
training. Teaching staff act as moderators, providing didactic aids. As a result, 
the topicality and applicability of the Information imparted Is more reliable 
fehan ^dien professional lecturers are used - the latter may be more famillcur with 
the contents/metbods of Instnictlon, but their remoteness from practice often 
TTwanq they have problems In adjusting to technological change and the conplexity 
of the requirements In the wor)cing process, ^xe continuous liiproveanent of the 
courses Is ensured on basis of evalxiatlon documents prepared by the technical 
experts: they contribute their work experience to the process of quality assur- 
ance In continuing training [BFl] . 

Cf . also A22BED, Luxembourg: "The need for training Identified at department level 
was put into specific terms by a technician from the "spectral analyses" depart- 
ment (the "officer") ^dio. In consultation with the Training Centre, prepared the 
specification finalized the design of the training progranme, the preparation 
of the content the organization of the practical part of the training. . . 
Transfer to the workplace Is guaranteed by the very concept of the case analysed, 
because training ccaxprlses a theoretical section of 40 hours and a practical 
section of 98 hours. In addition, retention of a nucleus of personnel from the 
old spectrometry centre enables the training as such to be extended In the form 
of a kind of sponsorship or ongoing monitoring" [LI] . 



ThuS/ in a number of caBea, the sui t ability of continuing 
training to meet demand and its availability at short 
notice are ensured by the use of non-personal leetming 
media, far example open learning materied.s, cooputer- 
based training/ heme stud^ materials. In this case, in 
particular, quality assinrance methods have to intervene 
in the developnent of the leeuniing materied.s; the eu::tual 
learning process is lcu:gely outside their sphere of 
influence. 



ATEA N.V. , Belgium, relies on permanent continuing training, but has problesns 
with providing training to relatively large groups of participants at the same 
time. Each enployee is supposed to be able to match "his** learning material to 
**his** time. The course form therefore often seems unsuitable. Instead, open 
learning materials are offered for independent study, with the availability of an 
esperienced coach (**non-classical courses**) . The quality of the continuing 
training is thus less dependent on the didactic skill of a lecturer than on the 
structure of the learning materials. It can thus be provided more uniformly and 
reliably than in conventional courses. **The quality of a non-classical course is 
mainly influenced by the contents of the course (not by the didactic qualities of 
the espert) . Guidelines for developing non-classical courses have more result 
than guidelines for the development of classical courses** [BFl] . 



Ganc^ts intended to strengthen the link between work 
and learning are xised in many case studies - but there 
is little mention of general methods for evaluating them 
or instruments for quality cisaxircuice in job-related 
continuing training. Isolated attempts to form a specific 
assessment of directly job-related in-house tredning are 
closely linked to specied. conditions in the firms pre- 
sented; there is virt\ially no description of genered. 
experience or even universal instruments of evaluation. 

Ihe justification given for the \ise of job-related 
continuing training is its effectiveness. It is s€u.d to 
circumvent certain bcurriers found in course-based con- 
tinuing training: for exasple, it is believed to inprove 
the practiced, transfer of \diat has been leeumt or to 
inpeurt: socied. and methodologiced. skills more effectively. 
Also, it takes place not in an educational environment 
but in the viorking world - so it has to prove its value 
directly in conpetition with econcmic objectives. While 
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there are still virtually no cases in quality 
assurance and evalxiation of job- related training are 
systematically applied, this is not only attributable to 
the fact that the re introduction of continuing training 
into industrial workplaces in Europe began only a few 
years ago and is still Icurgely at the experimental and 
project stage. In additional, there are difficulties to 
be mastered ^diich do not arise in the same form with the 
quality assurance of course -based continuing training. 
Such training is organizationally independent and has 
definable starting and finishing times - natural measur- 
ing points, as it were, to provide a starting point for 
rnfthhndg of ixput and output evaluation. By contrast, 
measures of on-the-job continuing training are difficult 
to define in terms of time and organization - learning 
and the application of vdiat has been learnt are combined 
into a simultaneous and continuous process. 



1.8 Methods of quality c^surance in in-house continuing 
training 

Depending on the forms of learning enployed and the 
objectives of quality assurance, the case studies mention 
numerous methods of training evaluation which will be 
considered as such in this section. 

Miethods of quality assurance and quality management are 
more than a mere monitoring of the quality of continuing 
tredning; but th^ are based on methods of evaluating 
continuing ^-raining and monitoring its quality. In the 
documented practical in-house cases, these methods are 
often not presented in a strictly separate and formalized 
manner. They are often employed in alternating combina- 
tions, and frequently constitute no more than specific 
elements within Icurgely informal procedures for quality 
assurance in in-house continuing training. 
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The broad spectrum of evaluation methods used in these 
cases will be classified in this presentation by forms of 
input evaliiaticn, output evaluation and process evaliiation.^ 




Methods of input evaluation evaluate the material and 
personal initial conditions of continuing training 
measTires in terms of the educational objectives in 
CGBsparison with the participants' prerequisites, the 
didactic and methological approaches used, and the 
syllabus. They assume that the provision of appropriate 
preconditions guarantees the quality of training 
measTires. In the case studies, the following forms are 
documented in quality assvurance in in-house continuing 
training: 

• determining and evalxiating training demand 



^ In the case studies, ccsnbinations of these ideal 
types regularly arise. They are not encountered in 
the pure form in any eopirical case. The subdivision 
used here is adopted for reasons of euialytical 
clarity. 



- selecting lecturers with reference to criteria of 
technical and didactic quality 

* selecting instructional methods and locations freon 
quality aspects 

■ planning the materied. training resources (premises, 
hardware) and the instructional media froon quality 
aspects 



In the case of ARBED in Luxembourg^, input evalxiation is undertaken with reference 
to a number of specifications: 

"Specifications; the training activities derived from an analysis of the identi- 
fied needs are defined in the form of specifications idiich, in their most 
conprehensive form, have the following structure and elements: 

structural section, with a statement of grounds, training objectives and 
evaluation criteria 

human reso\irces section, providing information on the participants, their 
seniority and, in partlculeu:, their previous training 

* management section, dealing with logistic ^lspects 

planndLng section 

financial section for budgeting purposes 

teaching section, >^ch deals with the objectives of training and the themes 
and their content and duration" [LI] . 

The same applies to the French SOLdAC case [FI] . 

The German study reports, by way of exanple, on input evaliiatlons by the Federal 
Institute for Labour in connection with the so-called Quality Decree and makes 
particuleu: reference to problems of pure input evaliiatlon: "Since the quality 
standards essentially verify input (quality, their prime f\mctlon is to provide 
information and guidance to the esployment exchanges. They have no monitoring or 
selective functions, at least in practice. In the case of individual measures 
taken by the esployment exchanges, intensifying the monitoring process has 
resulted in the discovery of a number of measiures suffering from significant 
quality defects.” 



1.8.2 Output evaluation 

The types of evaluation method encountered most fre- 
quently in the case stxidies are those initiated after 
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coBopletion of a training msaavre, Many of these methods 
draw conclvisions about the quality of the trcuning 
meas\are frcm its success or from the satisfaction of 
individual participants; all of them relate to individual 
training measiures. Instruments vised here cure:^ 

• Documented self-assessment by the participants at the 
end of the training measure [E4, E5, UK3] 

’ Final discussions between participants and lectiurer 
[DK2, UK4] 

- Participant questionnaires [BFl, E3, E4, F2, F3/ IRl, 
GR2, GR3S PI, P5, DK3, UK4] 

* Questionnaires to lectiurers [GR3] 

- Test results as indicators of the quality of the 
training measure [PI, UK2, DK3] 

- Assessment by participants ' sv^>ervisors following their 
return to work [BFl, E4, E5, FI, F2, F3, PI, P5, UK3] 

- Systematic observation of participants at their work- 
places [E5, GR2] 

’ Monitoring of productivity data after coonpletion of the 
training measiures [E5, IRLl, L4] 

Such sirple, and therefore widespread, quality evEQuation 



^ The cases cure presented not on a formalized basis but 
as informal descriptions \diich describe the evalu- 
ation instruments with varying degrees of detail . It 
can therefore be assumed that some instruments are 
also applied in cases vhere there is no specific 
report of them. The case references given here relate 
to explicit mentions. 

* In the case of [GR3] , participants and lecturers are 
questioned at the same time, and the results cure 
coopared in the evaluation process. 
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methods are based on the resiilts of continuing training 
measures. In many cases. It becomes apparent that such 
output evaluations are often of only limited signifi- 
cance: the actual process of continuing training Is 
outside the scope of the evaluation. Even In the case of 
material products, a qucQlty evaluation oriented purely 
toward resxilts suffers from a degree of randomness and 
Tjnrellablllty. The Inspection natvurally takes place after 
the event, and hence cannot contribute to improving the 
resxilt vdilch Is Inspected: It therefore provides only 
limited support for quality assvurance. In continuing 
training, as a cooplex sezvlce, resxilt-orlented evalu- 
ations as such seem to be of only limited applicability: 
the resxilt of continuing training measvures depends on 
many other factors as well as the quality of the continu- 
ing training measvure, such as the Initial status of the 
pcurtlclpants or special requirements In teinns of 
transferring vhat has been learnt Into vocational 
practice. In addition, the evaluation of resxilts pre- 
supposes a defined Interface between the continuing 
training and application [diases. Although this can still 
be determined In the case of continuing training measures 
based purely on courses, this Is no longer the case with 
the job-related and continuous forms of continuing 
training described In many of the Ccises. In some of these 
cases, therefore, output evalxiatlon Is regarded as a 
medlxjm to supplement other methods, and not as the 
sole basis of quality assurance In In-house continuing 
training. 
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Exanples o£ special methods o£ output evaluation £rom the case studies are: 

A combination o£ evaluation o£ the quality o£ training measures by the partici- 
pants* s\;pervlsors and the participants themselves Is £ound at AIEA N.V, , 
Belgium: "Participants In training courses evaluate the course a£ter conpletlon. 
This happens with an evaluation- sheet idilch requests a single score £or the 
training. A description o£ one weak and one strong point o£ the training Is also 
requested. The sheet has to be signed by the hierarchy o£ the participant. This 
ensures that the participant and hierarchy have a moment o£ conversation about 
the training" [BFl] . 

The National Bank of Greece S.A. also Involves participants and s\q>ervlsors in 
the training evaluation. Two surveys are carried out, one addressed to the 
participants a£ter the end o£ the course, and another six months later addressed 
to both the participants and their supervisors [GR3] . 

SMEs adopt a less systematic approach to evaluation projects. Nevertheless, the 
two French cases demonstrate that, here agadn, an attenpt is madn to evaluate the 
e££ects o£ the continuing training: "Hie subject o£ evaluation o£ the training Is 
a matter o£ curr en t concern. But the enterprise admits that it is not very good 
at this £unction. Although it can rely on a £ew global productivity Indicators, 
It is not e££lcient at ldentl£ylng the qualitative e££ects o£ training. The main 
£orm o£ evaluation conprises meetings organized 2 or 3 months a£ter the training, 
\diere an attempt Is made to analyse the technical contributions" [F2] . As regards 
the enterprise Bayaond Geoff ray, the £ol lowing is reported: "Among the practical 
methods o£ evaluation, one takes the £orm o£ a satls£action survey o£ the 
trainees. In addition to the evaluation In the strict sense, the enterprise 
conducts non- systematic monitoring o£ training. Ihus the Managing Director 
£requently asks his employees what they have learnt or are In the process o£ 
learning. The object Is not to check up on them, but to take a personal Interest 
In the content (what new technologies have been learnt, can anyone solve a 
problem ^dilch Interests him, etc.)" [F3] . 



1.8.3 Process-oriented e^roaches to evaluation 

Process -oriented evaliiation is not an independent effort 
like the evaliiation of the iz^nit and output of continuing 
training. It requires both of these, but relates their 
resvilts to each other on an ongoing basis and so makes 
them capable of evaluation. To vdiat extent ensuring 
certain preconditions for an in-house training measure 
has contributed to its quality can only be detexmined 1:^ 
reference to the restilts of a siibsequent output evalu- 
ation. Conversely, \diich successes axe attributable to a 
preceding training measure, and how, cannot be elucidated 
from a straightforward output evaluation. An analysis of 
the initial circumstances of the training measure is also 




G4 



62 



necessary. Virtxially all cases therefore report on 
methods ^diich combine iz^nit and output evaluation. As the 
Irish study summarizes it: "The key £\jnction of the 
accurate identification of training needs which specifies 
in output terms vAiat behavioral changes cure required and 
how it will be measured at the outset is the key to good 
training intervention and evaluation" [ISL] . 

Process-oriented ^proaches cure applied by conibining 
individual quality evaluation methods to fozm a system of 
continuous quality assxirance which is designed to 
evaluate and optimize the entire in-house training scene, 
not just individual measures . These approaches cure thus 
more methodiccLL and abstract than those designed for 
direct quality control of training measures. They are 
instructions for in-house quali ty management . 

In many Ccises, additional measuring points are provided. 
Not only cure for cui evaluation acquired at the sta^ 
and finish of a course, but the methods and 
organizational precautions of the in-house training 
system cure recoirded cuid evaluated in the course of fdiase 
models of the continuing training procedure, with a view 
to ciscertaining the quality of the continuing training. 
Process -oriented approaches are thus not solely confined 
to the evaluation of seminars and courses; they encceipass 
the ^diole continuing training process, starting from the 
determination of demand and advice on continuing 
trcuning, cuid xiltimately ensuring that vdiat has been 
learnt is transferred into practice. They evaluate not 
the final resxilt or the starting conditions of a training 
mecusure, but the actxial process of isplementation. 
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The Spanish building conpazxy DragadoB y Conatruccionea applies an integrated 
system of ix^nit, process and output evaluation: 

"1,1 *A priori* evaluation: this is carried out by experts in accordance with 
their knowledge of the progr am nes and of the context in idiich it is to be 
developed. It is undertaken in accordance with two criteria: instructional 

consistency and feasibility. 

Instructional consistency: In the p r ogr a mme proposal, details have to be given 
of purposes, objectives, content, rules governing evaluation and means, 
xnethodology, specific techniques, equipment resources, time management, 
recomnendations and addressees. 

* Feasibility: Resources and limitations relating to institutions, instructor 
training, time management, availability and equipment management. 

1.2 Evaluation of the application process: This covers all the activities carried 
out throughout the Isplementation of the programne . It includes : 

Permanent monitoring of isplementation; 

Identification of obstacles together with the validity of the solutions 
applied; 

Integration of processes, instruments, activities, etc. 

1.3 *A posteriori' evaluation: this is based on observing, measuring and analys- 
ing the effects of application, ^lese are measured on the basis of information 
provided by the participants, teachers and beneficiaries of the training" [E4] . 



In so fcu: aa the in-house continuing training is 

integrated into general internal strategies [c£. 
Section 1.1] / such process-oriented approaches cure 
beccaning increasingly important. It must be stated, 
however, that the implementation o£ simdi continuous 
global concepts o£ quality assurance within the firms is 
not yet consistently ensured in many case studies, even 
i£ continuous training is understood there are a 
strategic parameter euid an investment. In the majority o£ 
the case studies, reports still deal primarily with ad 
hoc evaluation methods. In some case studies, process- 
oriented approaches to evaluation cure Ccurried out in the 
context o£ multi-enterprise standards. In addition to 
certain nationed. qucdity progranmes for continuing 
vocational training, the "quality standard", ISO EtT 9000 
et seq. , plays a part in the majority o£ these cases [cf . 
Chapter E] . 
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It can be seen as an inportant advantage of process - 
oriented evaluation methods of quality assurance in 
continuous training that they provide not only standards 
but also aids to quality improvement. This means that 
i m p r oved econcmy and quality in continuing training can 
be actually bzxmght about, not just monitored. 
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A particularly ccnprehensive case that can be mentioned here is 
Tele f oiliest, Spain, ^diich systematically combines five types of 
evaluation: 

"Types of evaluation: Five types of evaluation are provided 
for, to develop this idea. 

• Preventive 

- Additive 

- Formative evaluation 

* Longitudinal 

- Inpact - detects" 

Pcurticulcurly interesting for quality assurance is formative 
evaluation, which aims at permanent optimization of the 
continuing training processes: 

"Formative evaluation: This is undertaken by analysing the 
return information on the quality of the actual action. Its 
objective is to determine, via this ouialysis, the degree to 
which objectives have been achieved and to correct possible 
shortcomings in the planning and development of the actual 
training action, with a view to ensuring the future training 
actions cure of higher quality than those under evaluation. The 
chart \diich follows shows how the evaluation fits into the 
training process." 



- evaluates 

- controls 

- analysis 

- verifies 



I. DRSCRimON OFTKF. TRAINING ACTTVIIY 



2. DEVELOPMENT 

T 



3. REJECT EVALUAnON |-»j S. MODIFV 



6. CONHRM 



7. NEW TRAINING ACTION 



> 
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2. Quality assurance in cocperaticn between firms 

and external training providers 

In virtually all documented cases from the Member States, 
cooperation between firms and training providers beccsnes, 
in one way or another, the subject of quality cussurance 
measures in continuing vocational training. 

Two fundamentally different forms of this ]cind of 
cooperation can be identified, ijiplying quality assurance 
strategies and procedures \diich themselves differ 
accordingly. 

- On the one hand, there are those cases in \diich large 
enterprises - as described in Chapter 1 - systematic- 
ally plan, design, implement and evaluate their 
personnel advancement and continuing training 
procedures as an integral part of corporate strategy. 

In these cases, external training providers are called 
vpon only for particular measixres in the ispiementatioin 
of continuing training. The form of the cooperation is 
determined unilaterally by the specific requirements of 
the large conceims. The training provider has to submit 
to these requirements, and the enterprise's quality 
ass\urance control mechanisms, vdiich are linked to those 
requirements . 



Such forms of cooperation, in vdiich training providers 
function as mere "sxppliers" of continuing training, 
cure to be found in the following cases. ^ 



# 


Name 


Country 


Sector 


Work 

force 


BFl 


ATE^ N.V. 


Belgium (FI.) 


Electronics, 
cnnimmi cations 


1,500 



A number of case descriptions of training providers 
are also relevant, but training providers are also 
included in the category of cooperation with SMEs, 
and so are listed there. 



5 



BF6 


Ministry’ for the Flemish 
coannunity 


Belgium (FI.) 






E4 


Dragados y Construcciones 


Spain 


Building 


12,000 


E5 


Telefonica Spanien 


Spain 


CnmmmA rma 


73,000 


PI 


SOLLAC 


France 


Steel 


20,000 


F4 


Renault France 


France 


Csu: manufacture 




GR2 


Elefis Shipyards 


Greece 


Shipbuilding 


2,000 


GR3 


National Bank of Greece 


Greece 


Banking 


14,000 


LI 


ARBED 


Luxenibourg 


Steel 


8,000 


L4 


Du Pont de Nemours 


Luxenibourg 


Chemical 


1,270 


PI 


Renault Portugal 


Portugal 


Car manufacture 


2,300 


UK3 


Walker Financial Solutions 
Ltd 


Dhited Kingdom 


DP systems house 


80 



On the other hand, the studies frcm the Meniber States 
also include Ccises in \diich the cooperative cunrangement 
between firms and providers goes feu: beyond the mere 
delegation of the practicalities of continuing tredn- 
ing. In pcur^icula r , small and medium- sized enterprises 
(SMEs) need specific cissistance from the external 
providers even at the stage of planning procedures, and 
subsequently in the form of an an-going advisory 
service during the entire process of in-bous© personn©! 
advancement, through to the evaluation of the success 
rate and efficiency of the continuing training. 

In these Ccises, cooperation tcdces on a totally new and 
innovative quality vAiich itself becomes, or has to 
beccane, the subject of quality assurance in continuing 
training [Joel Bonany in the French stucfy] . 

Such innovative forms of cooperation are picked out as 
central themes - biroken down by firms and providers - 
in the following Ccises: 
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# 


Name 


Countiry 


Sector 


Pifork 

force 


F2 


CELIT France 


France 


Industrial fil- 
ters 


50 


F3 


Raymond Geoffray 


France 


Preserves 


36 


IRL: 

all 


[Unidentified SMEs] 


Ireland 


[various] 


32- 

370 


P5 


Coopers and Lybrand 


Portugal 


Business 

consultants 


278 


OKI 


Bowles Outdoor Centre 


United Kingdom 


Outdoor education 


16 


DK2 


Cleveland Axhbulance 


United Kingdom 


Ambulance service 


296 


UK3 


Wallcer Financial Solutions 


United Kingdom 


DP systems house 


80 


# 


Name of training provider 


Country 


Type of provider 


BF4 


VDAB 


Belgium (FI . ) 


Government Institute 


BF5 


VIZO 


Belgium (FI.) 


AG Institute 


D2 


Weiterbildung Hamburg e.V. 


Germany 


Regional association pro- 
viders 


E2 


G.IMI-TENEO 


Spain 


Association of Public 
Enterprises 


E3 


INQl 


Spain 


Government Institute 


F5 


CESI - Normandie 


France 


Private training provider 


F6 


GRETA - Est Essonne 


France 


Government Institute 


GRl 


OAED 


Greece 


Government Institute 


6R4 


IVEPE 


Greece 


Industrial eaployers' 
providers 


GR5 


INE/GSEE 


Greece 


Trade Uhion providers 


L2 


Prolingua 


Luxenibourg 


Private provider for 
languages 


L3 


CFPC 


Luxeinbourg 


Government Institute 


P2 


IFP - Vocational training 
institute for banks 


Portugal 


Banks Training Institute 


P3 


fondetec 


Portugal 


Provider : electrical/ 
electronics industry 


P4 


PORTUCEL 


Portugal 


Provider: paper/cellulose 
industry 


P6 


lEFP 


Portugal 


Government institute 


UK4 


North Trafford College 


United Kingdom 


Private provider for 
firms 
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2.1 Cooperation between large enterprises anH training 
providers 

As illustrated in Chapter 1, quality cissurance measures 
in in-house continuing training are generally the expres- 
sion o£ a changed attit\ide towards the continuing train- 
ing o£ employees. Continuing training is perceived as an 
investment, \diich - like investments in buildings and 
machinery - pursues strategic objectives, and \diose costs 
are regarded as expenditure \diich is necesscury for the 
firm's success. 

To the extent that continuing training is no longer 
regarded as a social benefit provided by firms, the 
continuing training depeurtments in those firms must, of 
course, also sub mi t to success and efficiency criteria in 
the same way as all other departments. Thus, alongside 
the increased demand for continuing training, it is ed.so 
the cost/efficiency curgument \diich prompts many firms to 
buy in external training services instead of developing 
their own capacities for continuing training. 

Many firms even adopt the policy of thinning out their 
own continuing training departments so as to make their 
continuing training activities more flexible and cost- 
effective by using external providers. 
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Tbe case o£ Renault France shows that even large enterprises are increasingly 
resorting to services provided by external training providers. They do this to 
inprove the economy o£ their continuing training: 

"The case study relates to a move by a large enterprise towards restructuring its 
training system. The rapid increase in training needs pronpted the enterprise to 
increase the volume o£ training activities subcontracted to external bodies/ 
\diile decentralizing the purchase decision. Subjecting the training purchase 
process to quality assurance made it possible to control the risks o£ dys£unc- 
tioning o£ vAiat had become a complex system o£ £\inctiozdng. ... In order to 
improve production at a lower cost/ Renault implemented a total quality approach 
which assumes better organization o£ its own work and the work done by its 
suppliers and its network/ but also ass\mnes greater pcurticipation by its 
work£orce. ... The objectives aimed at by this approach are as £ollows: 

p ro m o ting a language and tools ^diich are co mm o n to all the decentralized 
purchasers/ so as to guarantee overall consistency o£ the purchasing style 
without the need to centralize it; 

embarking/ together with the providing bodies/ on a review o£ the structure o£ 
the retail costs o£ training activities/ with a view to improving the 
cost/e££iciency ratio o£ the services provided; 

endeavouring to eliminate waste/ by a joint e££ort by the principal and the 
supplier/ and so improve the productivity o£ the training production process" 
[F43. 

Elefala Shipyarda S.A., Greece, operates its comprehensive scheme o£ continuing 
training largely throu^ "a training depcurtment and an in company training 
centre" . VQiere external training providers are also brought in, they are directly 
compared with the training services provided in-house/ and are controlled in the 
light o£ the results o£ surveys o£ the quality and e££iciency o£ continuing 
training at Ele£sis Shipyards S.A. [GR2] . 



In a word: the trend towards econcsnizing in continuing 
training, \diich is linked to quality assurance in con- 
tinuing training, results in greater efforts being made 
to externalize the iroplementation of that training. 

This does not mean, however, that the external training 
providers can obtain a better price for their standard 
progr a mmes ♦ The reverse is true. In a similar manner to 
the companies sxpplying the mechanical engineering or car 
industries, training providers have to adapt coopletely 
to their customers' requirements. In their efforts to 
isprove quality and intzoduce the appropriate quality 
assiurance methods into continuing training [cf. 
Chapter 1] , the firms subject the external training 
providers to the same yardsticks e^s the in-house 
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cantlnuing training departments* The evidence of c[uality 
required by the firms, and the corresponding controls, 
cover not only the product (the continuing training) but 
also the process of ngplementation and the provider's 
actual organization - to the point of demanding certifi- 
cation under national or inteznational standards. 

"Tailor-made continuing training" is really being 
demanded for the first time, by firms \diich use their 
ccnpetence in continuing training matters to ascertcdn 
precise requirements, have specific ideas about the 
organization and methods of the continuing training, and 
ultimately inpose binding yardsticks for success. In 
these forms of cooperation the training provider is quite 
clearly the dependent partner and has to adapt his 
activities to the client firm. 

However, the cases show a nurnber of different specific 
forms vhich this type of coqperaticn can take as regards 
the active efforts by the training providers to adjust to 
their clients. 



2.1.1 Training providers beccme straightforward 
providers of services to firms 

In virtUcLLly edl the cases described \diich relate to 
lcu:ge enterprises, endeavouring to improve their quality 
or introduce quality assxirance into continuing training, 
external training providers are no more than assistants 
involved in implementing individual, precisely defined 
ccnponents of the in-house continuing training programme. 

In such cases they are no longer the focus of the con- 
tinuing training process and its c[uality assurance, but 
become the precisely defined means for this process. It 
is only by becoming completely subject to the c[uality 
assxirance methods laid down by the firms that they can 
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carry out ^shat is required of th@n by tbe fims 



This form of iinilateral cooperation between training provider and firm is 
described in particular detail in the French case of the buying-in of tra in i n g by 
Fenault : 

”^ie case stu(fy relates to a move by a large enterprise towards restructuring its 
training system. The rapid increase in training needs pronpted the enterprise to 
increase the volume of training activities subcontracted to external bodies, 
\diile decentralizing the purchase decision. Subjecting the tra in i n g pur chas e 
piTOcess to guality assurance rfy*d** it possible to control t h e risks of <^s func- 
tioning of what had became a conplex system of functioning. The case of Renault 
has been Included as representative of a large enterprise w h ic h , having restruc- 
tured its training system on the basis of decentralized \inits maJdlng siJbstantial 
use of external training services, decides to subject its tra in i n g purc h asing 
process to quality assurance" [F4] . 

As part of its efforts at modernization, Renault decentralized responsibility for 
continuing training to the various branches. As an aid to those responsible for 
decentralized procedure and as a means for guaranteeing a degree of consist- 
ency of the level of continuing training in the enterprise as a vhole, the 
procedures for buying in the continuing training were codified jointly. 

"Th e purchasing procedure conprises 6 stages: 

1. The decision vAiether to undertake or buy in training, escpressed by the ^gbraae: 
"Make or buy?". A decision -maJcing aid enables this decision to be automated. 

2. The systematization of the specification. This formalizes in precise terms the 
problem \diich the training is intended to solve, the type of response expected 
anH ♦•'hft arrangements for its Isplementation. 

3. The definition of rules for inviting a te n d er , and especially situations in 
whic h the invitation to tender will be used. 

4. ThB arrangements for implementing the invitation to tender: especially 
laxmching of the op^s^tion and evaluating the bids. 

5. The formalization of a teaching contract, designed as the operational 
implementation of the specification. It lays down the specific arrangements 
for performing the service, and those for monitoring and evaluating t h e 
training. 

6. The setting -tp of a training agreement. In particu l ar, this defines the legal 
and financial conditions on ^diich the service will be provided." 

The objectives pursued by Renault with this standardized buying-in of external 
continuing training are primarily connected with iuproving the economy and 
efficiency of the continuing training. Requiring, and vhere appropriate enforc- 
ing, Increased cost-consciousness on the part of the tra in i n g provider and 
inproving productivity in the continuing training measures are characteristic of 
these attempts to introduce quality assurance into continuing training [F4] . 



In the context of the systematic efforts by the large 
enterprise to rationalize all phases of its own continu- 
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izig staff training activities and subject them to 
appropriate quality assurance mechanisms/ the external 
training provider initially appears as a foreign bod^, 
svibjected to precise quality and cost requirements. 



In isolated cases / these types o£ relatioxishlp between training provider and firm 
also occur in formally organized SMEs: 

Walker Financial Solutions Ltd. , United Kingdom, 80 enployees "develops computer 
software for financial applicatioxis" . The role o£ continuing traiziing is an 
important one, because in this sector "skills are in short sipply, and technology 
is rapidly changing". It was decided that precise objectives and standards should 
be defined before any training activity in the firm. As well as internal multi- 
pliers, the firm also cooperates with external providers. Determination of 
objectives, the planning of training and the svibsequent evaluation all remain, 
however, in the hands of Walker Financial Solutioxis Ltd. "Training en^pliers are 
chosen via a supplier selection procedure, \diich determines their ability to meet 
defined objectives for training. After the training enpolyees are asked to 
CGBzplete a questionnaire evaluating the training provided. The performance of the 
provider is also assessed through the debriefing process after the training 
activity, ^diich determines how successfxil the training was in meeting precourse 
objectives and business benefit" [DK3] . 



This also applies/ natijrally/ to criteria/ methods and 
organization for evaluating the continuing training; 



The arrangements in the specification for external providers at J^enault in Arance 
include: "Defining criteria for evaluating the training, to be applied to any 
activity: evaluating the Individual benefits at the conclusion of the training, 
assessing the training service via the quality of the service provided, and use 
of the benefits gained in a vocational situation" [F4] . 



Quality assijrance in this type of cooperative relation- 
ship between a large enterprise and an external training 
provider is largely attributable to the firm's initi- 
ative. Instruction and supervision by the firm determine 
the relationship. Ihe training provider is coopelled/ 
sirply by the codified requirements in the specification/ 
to undertake certain quality assurance measures if he 
does not wish to lose the client. 

This procedure adopted by large enterprises/ involving 
the extemalization of large areas of continuing tredning 
by the buy-in of training providers but also making the 
external providers conoply with extensive specifications/ 
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has effects on the develppnent of the continviing training 
market [of. Chapter 3] . 

The quality of the cooperation thus generated between 
firm provider is quite unilatered.ly defined hy the 
firm. This contains an innovative element for the 
reorganization of many traditional training providers 
vho, hitherto, still often regarded continuing tredning 
in a stqjply- oriented, missionary light with little 
orientation towards applications. In addition, this 
subsunptive compulsion has brought ho m e to many pro- 
viders, for the first time, the idea of quality assur- 
cuice, of making their activities more effective and of 
cost-consciousness . 

On the other hand, this kind of regulated cooperation can 
generate important innovative impulses, vhich the train- 
ing provider could introduce into the firm's continuing 
training prograrane. The danger exists that the formal 
requirements in the specifications cure perceived by the 
t-raiTving provider as an external compulsion, so that only 
formal lip seirvice is made to them. The motivation to the 
independent development of the quality of conti nu i n g 
training is lacking vhen the provider is subjected to the 
imposition of outside requirements [cf . Chapter 4] . This 
would be particularly regrettable as regards the innova- 
tive ccmpetence that training providers need to show vhen 
working together with SMEs. 



2.1.2 Tredning providers endeavour to anticipate firms ' 
requirements: the sectoral a p proach to quality 
cissiurance in continuing training 

In a number of the cases from the Member States, training 
providers are introduced vhose cont inu ing trai n i n g 
activities irelate to firms in a specific ind u stry. 
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# 


Name of training 
provider 


Country 


Type 


El 


aeede 


Spain 


Spanish Association o£ 
Uhlversltles for Management 


BF4 


ehsal 


Belgium . (FI . ) 


Management school 


P2 


IFB 


Portugal 


Bank's training Institute 


P3 


FUNDETEC 


Portugal 


Private provider working for 
the electrical and electronics 
Industry 


P4 


PORTDCEL 


Portugal 


Training provider created by a 
group of firms (pa^>er and 
cellulose Industry) 


BF5 


VIZO 


Belgium (FI.) 


AO Institute; training provider 
specializing in SMBs 



Scane of these providers are institutions set by a 
peurticular industry association [P2, P3, El] , soane result 
from a ccamomity of purpose among various firms [P3] , and 
some are private training enterprises which have selected 
a particular focus for the content of their activities 
[P2] . 

What these training providers share is a tv«o- stage 
procedure for adapting to their customer's training 

needs; 



* In a first stage, they take an active part in endeav- 
ouring to determine the present cuid futiire continuing 
training needs of the firms in their sector or their 
custcsner group. At the same time, they also try to 
anticipate this group's quality concepts and adjust 
their own quality assurance to s\iit those ideas, or 
endeavour to obtain the appropriate certification under 
relevant standards. 

niese "sectoral" tredning and quality requirements are 
determined 1:^ systematic and regularly repeated manage- 
ment surveys addressed to the firms within thft 
industry. The resrilts are analysed and synthesized by 
€3q>ert ccmmittees. 
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An example of this procedure Is offered by the Banka' Vocational Tr a i n i n g 
Institute [IFB] In Portugal: 

"Its features make the Banks' Training Institute the main institution providing 
vocatiozial training services in the banking sector. The Institute's a nnu a l 
training plan is therefore drawn so as to meet the vocational tra in i n g needs 
of ng institutions in general and those associated with the Portuguese 

Association [APB] in particular. ... To ensure a correct match, needs are 
analysed at regular meetings of the IFB's Instructional Counsel, attended by 
representatives of the humart resources divisions of the associated banks. J^>art 
from this formal link with its "potential clients", the IFB m a in tains very close 
ayiri regulsT contacts with all the banks, vhich naturally supplements the regu l a r 
diagnosis by the Instructional Counsel. The annual tra inin g plan is drawn up on 
the basis of the needs identified. These derive from organizational, technologi- 
cal or other changes involving a modification of the functional content of the 
jobs axid needs anticipated by the IFB on the basis of foreseeable trends in the 
sector" [P2] . 

PORTUCEL, another Portuguese training provider, ge n e r ated by a group of firms in 
the paper ami cellulose industry, determines the d em a n d for tra in i n g by circu- 
lating questionnaires in the firms and through the industry association [P4] . 

FI3NDETEC, a private training provider in Portugal aims at the m ediu m -term 
anticipation of needs in the electrical and electronics i n d us tries through an 
advisory counsel of associated firms, direct customer contacts and also univer- 
sity contacts [P3] . 

North Trafford College, a private British tra in i n g provider, carries out job- 
related continuing training in industry. The training measures are closely linked 
to the client's working processes, enabling the provider to gain knowledge and 
skills to determine future training demands [XJK4] . 



• This sector-based forecasting is given snore specific 
form in a second stage by direct customer contacts with 
the specific firms. 



In the case of FDNDETEC, for exanple: "The client enterprise informs FONDETEC of 
the features of the group. Nevertheless, at the start of the tra inin g process, a 
diagnosis is undertaken in order to adapt the tra in i n g to the needs of the 
trainees” [P3] . 



In this way, training providers - especially those 
specializing in a particular sector - try to anticipate 
customer requirements among the firms and to reflect them 
in their own processes and structures . The improved 
quality, and quality assurance, of their continuing 
training activities thus become the guid in g principle of 
their work. Customer requirements become the basis of 
their quality assurance efforts, often taJcing personal- 
ized form as an advisory committee made iip by companies 
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in the industry. 



On the basis of these initial conditions, training 
providers define internal procedures for ensuring and 
achieving quality. These relate to: 

- suitable continuing training conc^ts 

- suitable continuing training contents 

- suitable continuing training methods 

- suitable continuing training personnel 

- suitable evaluation methods. 

i^spropriate methods of evaluation and control cure devel- 
oped and inplemented. In particuleur, methods are 
installed for ensuring internal and external feedback 
between all those involved (instructors, trainees, 
si:{>ervisors, workplace colleagues) and the systematic 
auditing processes within the provider's organization. 
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The auditing process at FUNDUTEC can serve as an exaoople: 



"Throughout the process, a specialist team undertakes an instruction audit. On the basis o£ a 
reference framework of explicit criteria, the team systematically acquires data on the tra in i n g 
system, its res\0.ts ami its effects, in order to Identify problems and take appropriate 
decisions for solving them. This audit relates more specifically to the quality of the instruc- 
tional services, which includes evaluation but is not co nf ined to it. 

One of the instrrmients used to evaluate the training is the questionnaire. The questionnaire 
makes it possible to evaluate the organization of the training activity as regards environment, 
ccaxputer equipment, teaching equipment, etc. It also evaluates the extent to vhich the objects 
of the programme are achieved, the length of the module, documentation , content, etc. 

The trainees also evaluate the instructors' performance and their technical and teaching 
skills. Thus, they analyse the methods used, the instanictor's ability to motivate and his 
relationship with the trainees, ^le questionnaires are sumnarized and subjected to statistical 
analysis, ami t-ha result is notified to those involved in the process: instructors, pla nner of 
the training, client enterprise, etc. In addition to the analysis of the questionnaires, 
statistical studies are carried out on the basis of indicators vhich make it possible to 
monitor absenteeism and the results of the learning period. 

As wall as the collection ami processing of the questionnaires (database processing) , a special 
method for conducting a teaching audit has been devised, ^ils makes it possible to analyse the 
training activities in qualitative terms and to take effective 'real time' measures. 

During module, these audits gather information, by means of scales, on the various 

protagonists in training: tbft course coordinator, the module coordinator, the instructors, 
the trainees, the secretaries, etc. 

^le audit analyses vdiether tbft programmes are suitable for the target public (level, content, 
methods), whether the. training objectives are suitable for the constantly changing vocational 
situation, vdiether the objectives are suitable for the legislation governing trai n i ng , whether 
teaching resources (computer hardware, software, manuals, videos, etc.) are suitable for 
the content, whether it is complete, \:pdated, practical, motivating, etc. 

The audit studies whether the instructors are technically and educationally ccnpetent, vdiether 
they are in contact with practical situations, vdiether they conduct research in the field in 
which they work, vdiether they have isproved their teaching methods, and vdiether they undergo 
content training. 

The audit also examines vdiether the teaching methods are revised and given great depth, vdiether 
they are tested, ami %diether they adjtist to sociological and technological changes. 

This system obliges the audit team to make daily visits to the training premises throug^iout the 
course, in order to gather tba material which will enable it to provide feedback on a 
continuous basis rather than at the end of the process. 

In addition, this team generally arranges interviews with the tra ine es, instructors and ot h e r 
participants in the training process. 

At tmti of each training period, an individual report is drawn up for each course. The final 
report, which aims to disclose the quality indicators relating to the training, is drawn up on 
tbft basis of the joint analysis of CEC reports" [P3] . 
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As alreacfy noted, these extensive indqpendent anticipa- 
tory efforts by certain training providers with an 
industry background cure no substitute for the second 
stage of direct custooner ccmnunication and adaptation 
with the various fixxns. This is the only way in vdiich 
continuing training can be genuinely "tailored". 

Unlike the type of provider described ecurlier, vdiich 
merely reacts to firm's ideas, the sectorcLL provider has 
the opportunity for an informed dialogue with the firms. 
As will be seen, this is the essential requirement for 
working with SMEs. 

The procedure euiopted by the Government institutions 
documented in the case studies is more globa l than in the 
case of training providers \dio speci£j.ize in particulcu: 
sectors, ^hese incltide in Spedn, GE^ETTA in France, 

VDAB in Belgium, QAED in Greece, The FedereQ Institute 
for Labour in Germany, FAS in Irelemd and lEFP in 
Portugal. In their quality assmrance work, these institu- 
tions endeavour to anticipate or forecast eaployment and 
training needs, both in the various sectors and on a 
regional basis. A scientific inventory is often used for 
this pusrpose, and considerations of socicJ. policy also 
play a part in the attenpt to determine the training 
needs. Many government institutions joaike a peur^icul ar 
effort to devise concepts and training services to s\iit 
SMEs. 



2.2 Inproving the quality of cooperation between SMEs 
and external training providers 

It may seem amazing at first glance that the documented 
cases from the Member States include a significant nusiber 
of SMEs \diich are cLLreax]^ concerned with matters of 
quality assxnrance in contin\iing training. 
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This ctnce again makes It clear that, as regards questions 
o£ In-house continuing training, the group of SMEs Is a 
heterogeneous one. As well as enterprises \dilch are very 
hesitant about adopting the Idea of continuing training 
for enployees, there are oth^s \dilch cure very active In 
this field. 

Documented cases of SMEs In our sample of quality assur- 
ance In continuing training cure: 



# 


Name of the SME 


# 


Name of the SME 


BF3 


CKZ W.F. 


P5 


Coopers and Lybrand 


F2 


Cel it France 


UKl 


Bowles Outdoor Centre 


F3 


Raymond Geoffrey 


UK2 


Cleveland Ambulance 


ILL 


[all] 


UK3 


Walker Financial Solutions 
Ltd 



Since SMEs always meet their need for continuing training 
by cooperating with eKtemal training providers, a great 
many of the documented cases of training providers eure 
also relevant In connection with the question of quality 
assurance In cooperation between SMEs and training 
providers . In pcurtlculeu:, use has been made of the 
following case studies of training providers to gain an 
Idea of the form of cooperation between SMEs and training 
providers : 



# 


Name of the training 
provider 


# 


Nsaae of the training provider 


BF5 


VIZO 


L2 


Prolingua 


D2 


Weiterbildung Hamburg e.V. 


L4 


CFPC 


D3 


CERTQOA 


P3 


FUNUUTEC 


E3 


JNEK 


P6 


lEFP 


GRl 


OAED 


UK4 


North Trafford College 


GR4 


IVEPE 







One thing Is clear: i m p r oving the quality of cooperation 
between training providers and SMEs, cmd extending that 
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inprovement to quality assurance procedures in continuing 
training, are central to any modeznization of SMEs in 
Europe. 



It is important, however, not to overlook the fact that 
in-house continuing training and its evaluation in large 
enterprises serves other purposes apart from providing 
necessary qualifications: functions associated with the 
filling of jobs and payment of bonuses, and functions 
associated with the irplementing of changes in work 
organization. In small, less ccmplex enterprises, these 
functions are usually performed in a less formalized way. 
Quality assurance in these cases, therefore, really is 
initially confined to planning continuing training 
measures and quantifying their success. It is at least 
doubtfxil, therefore, \diether SMEs should be subjected to 
formalized and detailed training planning and quality 
assurance modelled on large-enterprise structures. It is 
precisely in SMEs which are unaccnistcmed to training that 
the application of oversize instruments can further 
increase possible reservations regarding continuing 
training for eaployees. 

The relatively low level of planning intensity in SMEs 
extends to virtually all sectors, including the direct 
objectives of the enterprise, and is not confined to 
continuing training. If it is true that SMEs nevertheless 
do no worse than large enterprises in ccnpetition, 
dispensing with long-term planning must also involve 
cuhrantages. An essential cooxpetitive advantage enjoyed by 
SMEs, for vhich they are envied by many large enter- 
prises, especially today, is their flexibility. They can 
often react more quickly to changes in markets and 
technologies. As far as their eoployees are concerned, 
this means that they need eaployees whose qualifications 
ensure that they can come to grips with changing reqiiire- 
ments in a short space of time, and that they can carry 
out a wide variety of different teisks on the basis of a 
less clearly marked division of labour. In order to 
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provide such qualifications, however, SMEs need not 
detailed long-term planning of all training measures but 
a continuous developnent of the potential - in other 
words, the flexibility and creativity - of their 
enployees, ccnibined with technical training courses ^diich 
are triggered on an ad hoc basis by current needs . 
Quality assiurance has to allow for this need. 

Quality assurance in continuing training for SMEs has to 
be measured against whether it also provides usable 
concepts for their specific requirements. 

Quality assiurance concepts for SMEs are not "discarded" 
variations on models used by large enterprises but have 
to meet different criteria of their own. What may (still) 
make sense in a large enterprise can easily lead to 
bureaucratization and fossilization in SMEs. Measiures to 
determine training needs and evaluate continuing training 
measures have to be in appropriate proportion to the 
financial, human and material resources available to 
medium- sized enterprises, ^leir scale, and the precision 
of their results, need to be measured not against 
academic standards but against the training problems 
vhich need to be solved. 

The traditional product policy of training providers in 
the continuing training sector, offering a ready- to-use 
instructional conc^t or curriculum to the enterprises, 
is increasingly rejected, in particular by small and 
medium- sized enterprises. There seem to be three essen- 
tial reasons for this: 

* First g those enplqyees of the SMEs vho receive the 
offers are generally not specialists in career advance- 
ment or continuing training. This makes it correspond- 
ingly difficult for them to assess continuing training 
needs and select appropriate measures. In such cases, 
uncertainty often results in general rejection, shift- 
ing the responsibility for continuing training on to 



the enplpyees personally, criticizing the goveinnnent 
t r ai n i n g system, and a tendency to take a scmevdiat 
mistrustful view of providers of continuizig training. 
Systematic planning of continuing training is an cd.ien 
concept for most of these enterprises, and the flood of 
product brochures is perceived as more of a nuisance 
than a source of information. This that tradi- 

tional cuivertising strategies are targeting a clientele 
vhich has great difficulty in creating a link between 
the continuing training offered and its own everyday 
reality. 

’ Secondly f vocational leeuming, and especially continu- 
ous lecuming, in those enterprises \diere its importance 
is recognized is increasingly beccming an activity 
vhich is integrated with the working procedures, 
organization and working processes and so cannot 
readily be provided by external courses. 

Catch{hrases such as "job-related learning", "integra- 
tion of work and learning", enterprises as "leeuming 
organizations", make it clear that, especially in 
learning- intensive enterprises, such processes are 
recognized as exceptionally important for organiz- 
ational development and, for that very reetson, should 
pri mar ily be integrated into the working routine. 

M a n a g ement roles within the enterprise take over 
continuing training functions, and continuing trcdning 
beccmes an instrument of management. If enterprises are 
serious about the strategic importance of personnel 
advancement, this must mean that continuing h-'rai irinj 
processes take place as close eis possible to th e 
worl^lace, and that feedback takes place not only 
between lecuming and working but also between lea rning 
and organizational changes. 

Ihe concept of learning here is undergoing a change of 
significance. It is not only concerned with individueU. 
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eoployees being taxjght to do particular tasks better. 
It is eJ.so concerned with \diole enterprises learning 
active skills of adaptation and innovation in changing 
markets. For this, too, the individual learning pro- 
cesses are naturally of central importance, but the 
subjects and objects of learning are changing greatly. 
If corporate learning is the objective, then the focal 
point of individual learning lies not in familiar- 
ization with certain technologies but in familiar- 
ization with the specific application of those technol- 
ogies in the interests of the enterprise. Efficiency 
and creative improvement in job performance can best be 
lecumt at the workplace, in the working environment. 



- Thirdly, the orientation of content, organization and 
cost calculation of the continuing training services 
offered by external providers are still greatly influ- 
enced by academic principles. Ihe aspect of practical 
application within the firm is not veiry pronounced. 

Accordingly, syllabuses are oriented towards ideas of 
completing coverage of a particular "subject", and are 
technically or scientifically centred rather than being 
oriented towards practical application. Organization of 
instruction is based on the school class principle, and 
this also applies to the cost calculation. Quite apeurt 
from the fact that such forms of instruction are 
xinsuitable in terms of the current qualification 
requirements in modeim enterprises, it is out of the 
question for SMEs to dispense with the services of 
several employees for an extended period and to fund 
the costs of doing so. 




Ihe xinsatisfactory situation of an unacceptable train- 
ing product range on the one hand and a reluctant 
attitude towards continuing training on the part of 
SMEs on the other can only be eliminated by new forms 
of cooperation between training providers and firms 
\diich offer "tailor-made continuing training" for SMEs, 



too. 
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The case o£ Prolingua, Luxoabourg, describes the planning and lixplementation o£ a 
tailor-made continuing training measure In the foreign langtiage sector / carried 
out by the provider Prolingua In cooperation with a Luxembourg investment fund 
company* 

A characteristic of this case Is the xinrestrlcted cooperation between the two 
partners even at the stage of planning and designing the continuing training 
measure. A five- stage procedure was used to produce joint solutions: 

* an entry test establishes the linguistic conpetence of future participants. 
(Ihls is done partly to describe shortcomings In skills and partly to form 
homogeneous groups for continuing training.) 

* an analysis of needs identifies the precise linguistic skills needed In order 
to work In the various departments of the enterprise (reading^ writing, 
listening and speaking In the foreign language) . 

* a joint agreement on content by future participants and Prolingua enployees, 
based on the analysis of needs. 

the selection and training of the lecturers. 

the selection of the training material, taking Into account working practice 
In the Investment business. 

This procedure Is formally guaranteed through quality assurance agreements, 
various instruments are used to evaluate the results of the measure: 

"Methods of implementation: 

A number of methods have been enployed to ensure quality 

* Evaluation of the participants after the course. In the form of tests 

Reports by Instructors on the progress of the course, submitted to the person 
responsible for training. 

"Self-assessment" questionnaires for participants. 

Feedback request sent to conpanies (poor response rate) 

Supervision by the Prolingua management during the course. In general, one of 
the members of the management participates In one of the sessions to give an 
assessment of the conditions under which the course Is being held." [L2] . 



What seems inportant in general terms about this pro- 
cedure is that this form of "tailoring" continuing 
training gives rise to a new, independent form of cooper- 
ation between training provider and firm, which is itself 
subject to quality assurance. 
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Spectrum of training 
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Figure 1 



What is created is an area of joint activities and 
responsibilities \diose various ccopartixients - analysis of 
training demands, planning and implementation of the 
continuing training and evaluation of measures - also 
require joint quality assurance. 

- Agreements on suitable procedures for the analysis of 
needs are necessary. The respective shares of the part- 
ners involved have to be fixed and reviewed. 

- The preparation of the continuing training plan (con- 
tent, methods, organization) and the implementation of 
the continuing training (lecturers, infrastructure, 
materials, etc.) have to follow mutually agreed 
criteria and rules, and be siibject to review. 

■ The evaluation is based on jointly designated success 
criteria, agreed forms of measurement and valid instru- 
ments and methods. 

Ccises illxistrating this type of cooperation between 
training provider and SME generally make it clear that no 
ideas exist regcurding quality assurance of this cooper- 
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atlon Itself. 



Depending on the case, either the training providers 
design their contribution to this kind of cooperation 
vdth reference to agreed quality concepts, or the firms 
pursue their continuing training activities in the light 
of quality assiirance aspects and the role of the pro- 
viders is based on this. This is only natiired, since this 
form of cooperation is still very new and cannot itself 
be a subject for quality assurance. 

It follows that both partners to the cooperation have to 
aim at, and monitor, quality improvements cOid quality 
assTirance measures. Since SMEs generedLly do not enploy 
specialists in continuing training matters, it often 
falls to the providers to take the initiative. This is 
confirmed by the documented cases from the Ifeniber States. 
Increasingly, tredning providers endeavour to provide 
quality assurance in their cooperation with firms. They 
do this primarily for marketing reasons in increasingly 
ccBipetitive mcurkets [cf . Chapter 3] . Government training 
providers have also made the selective promotion of SMEs 
a central concern . 
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Atteoipts by training providers to iinprove the quality o£ their cooperation with 
SMEs are documented in the following cases, among others: 

An example of how a provider inproves its coaxpetencies - and hence the long-term 
quality of its measures - by offering job-related continuing tra inin g can be 
found in the BritiBh case study: 

Trafford College, Manchester specializes in the delivery of general, 
vocational customised progranmes of training to industry, commerce and 
coonnunity on a local, national and international basis. A large proportion of 
training and tuition is designed, developed and delivered in the workplace 
itself. Such flexibility in approach enables In d us try to develop an effective, 
technically proficient workforce without disr\q>tion to staffing levels of work 
schedules. At the same time the College is provided with a continuously vpdated 
knowledge of the particular needs of the client industries and their enployees." 

In the case described, North Trafford College ran cont in ui n g tra inin g courses for 
Hays Chemical Distribution Ltd, a medium-size chemical company. The object was to 
convert the NVQ standards into "process operations" at Hays . The training 
provider had previously collaborated on the initial planning of the training and 
analysis of needs, together with ccopany experts. The analysis of trai n i n g needs 
was able to draw on the ccopany's established enployee assessment system. Quality 
assurance measures for the training were planned and inplemented jointly, the 
preceding assessment was undertaken by the provider and the compsuiy separately 
and Izxdependently of each other. 

North Trafford College in the United Kingdom tries to structure the quality 
assurance in cooperation with client firms on a partnership basis, the quality 
assurance measures being adopted independently by the two partners in t he ir 
respective areas of responsibility. These Include measures for the formative 
evaluation of the cooperation process. 

"College trainers discuss matters of qu&lity and progress with the personnel 
manager, mentors and students frequently. Feedback between trainer and trainee is 
continuous. The Cooxpany provides a f\ill complement of resources to s\pport 
trainees e.g. training facilities, text books/work manuals, stationery etc. in 
order to help make the learning as barrier free as possible. Tutor marked 
assignments are channelled throii^ the Personnel Manager to trainees . In this 
way, progress is further monitored, deadlines adhered to and extra help provided 
if needed. Counselling, to combat the fear of learning often experienced in 
mature trainees long past compulsory and Initial formal education, is provided by 
both tutors and the Personnel Manager." 

This case stud^ shows how the quality of continuing training can be efficiently 
measured and improved if both sides - training provider and firm - make their 
existing instruments and resources available to each other, ^le training provider 
sums up appropriately: 

"The close relationship with the Company provides mutual )cnowledge of culture, 
nftoHa and \inders tending . Success breeds success and helps to ensiure the future of 
the College service" tOK3] . 
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The Iiabour Institute of the General Vibrkers* Confederation of Greece (INE/GSEE) 
aims to develop, in a d dition to conventional vocational training measures and the 
training of union officials, "inside and outside of the canyanies training 
activities applying particix>atory training methods that primary aim at the 
training of decision-makers, administrators, training developers and trainers in 
order to develop and support the function of training strxictures inside the 
coppanies" . Consequently, the firm's cospetence for independent continuing 
training is isproved by an external training provider [GR5] . 

CFPC, a government continuing training institution in Luxembourg, is trying, by 
way of a pilot project (FORCE) , to inplement a joint continuing training scheme 
with a retail supermarket. Quality assxirance elements have been designed and 
applied for this purpose: 

"Cbntrol and monitoring of the partnership: regular meetings throughout the year 
are planned, at which working plans will be drawn up, distributing the tasks 
within the various groups. The results of these joint deliberations will make it 
possible to prepare the content of the various branches and to produce the 
instructional support equipment for the proposed forms of training. ... 

The EQUALITY ASSURANCE ' procedures set up; The Quality Assxirance procedures 
defined by the partners under the FORCE project are based on: 

A partnership -based training Installation between enterprises (Including the 
MD, the managers and the 'trained enployees') and training centres. 

* The training plan ^diich adheres in detail to the various stages of the 
training course 

A pilot project making it possible to regulate the training developed between 
private and public partners 

* The selection of 'trained persons' by the active staff on site 
Intecfration of the training times into working hours 

The definition of the instructional content after the production of the job 
descriptions 

* Acceptance of respoi^lbility for the financial aspect of the training (FORCE 
project) 

Use of a tutor \dio is an enployee of the enterprise 
Scheme combining training and work (action training) 

Assessment meetings with a 'trained' tutor and CFPC 

Self-assessment meetings enabling each participant to be called into question 
and analysed 

Certification backed up by internal certification from the enterprises 
concerned, with the possibility of promotion depending on the positions 
available" [L3] . 



On the other hand, however, it is quite appcu::ent from 
scene of the documented cases that SMEs, too, take the 
initiative and make independent efforts to produce 
criteria and procedural forms for improved cooperation 
with external training providers. 
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13ae French firm RaymoDd Geoffray, a small enterprise with 36 enployees ^lAxlch 
produces preserved foods , has been Involved since 1991 in the process of improv- 
ing the quality of its organization, with a view to certification u nd e r AEAQ 
1995. 

In course of these efforts to modernize the firm, comprehensive cont inuin g 
training for staff and quality assxurance in that sector became necessary. 
Analyses of activities and training needs revealed defects in the enployees' key 
qualifications (lack of flexibility, willingness to take responsibility, etc.) in 
the field of technological learning processes and especially in hygiene stand- 
arx3s. 

In consultation with an external training provider, trai n i n g plans were drawn \jp, 
inplemsntation strategies were developed and carried out, and an attempt was made 
to evaluate the procedure. 

i^art from beneficial effects on the quality of the firm's production, one 
result is a broad general conmitment by the entire workforce to all the firm's 
interests. This also fiqplies to the actual cont in u in g tr ainin g, ^ch takes place 
more and more frequently at the workplace through reciprocal learning. Informal 
team activities take place with a view to pl anning and implementing cont in ui n g 
training. 

Despite all this, we encounter the typical problems experienced by SMEs vhen 
underta3cing continuing training: cost pressure and organizational problems permit 
only a gradual (step-by-step) progress towards new lines of organizational and 
KiiTwan resources developanent . Evaluation remains a problem: it is not always 

possible to comply exactly with the cont inuing tra in i n g plans. 

But case also shows clearly that, a n d how, SiEs can treat t he costs of 

training as an investment and, through considerations of quality, 
succeed in improving continuing training and employee motivation. Increasing 
competence in continuing training matters also fi n ds expression in new require- 
ments \diich external providers are asked to meet. The firm is de m a n di n g greater 
market transparency in this sector through quality certification of the providers 
[F3] . 



In terms of content, the cooperation to be encouraged 
between trodning providers and firms for the purposes of 
adequately planned continuing training in SMEs can be 
described in somendiat greater detail . 

In description vdiich follows# a distinction is made 
between the analysis of training needs, planning and 
irplementation, and evaliiation, as the separate stages of 
cooperation. 
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2.2.1 Cboperation in the analyBis of training Hgananr^ 



Analysis of training needs and a training advisory 
service are the logical first stage of cooperation 
between provider and firm. This £hase is to ensure the 
active involvement of all concerned, and must tedce the 
fozm of a joint action, A cocperative model of analysis 
of needs beccmes necessary, using external expert know- 
ledge eis well as in-house know-how in order to initiate 
optional planning of human resources developnent . 
Ekoplqyee acceptance and necessary motivation to master 
the inplementation of technology and the obstacles to 
continuing training are additionally ensured through 
enplqyee participation in this planning. This means that 
the provider's external experts merely provide informa- 
tion and advice, \dxile the employees and the management 
make joint decisions. 

An analysis of training needs carried out in this way 
simultaneously becomes a permanent process of organiz- 
ational and human resources development, following the 
concept of an enterprise as a "learning organization" . 
Internal continuing tredjiing groups would be an example 
of such innovation (cf. the outline description of the 
French firm Raymond Geof fray [F3] ) . 

Quality cissurance in cooperation between SMEs and train- 
ing providers would therefore have to ensure a procedure 
for analysing training needs \dxich guarantees active 
employee participation in that analysis as well as the 
processing of the external expert reports and the commit- 
ment of management. In addition, the continuity of the 
process should be guaranteed by the organizational 
cunrangements . 

approaches to the analysis of trcdning needs as a cooper- 
ative process between provider and firm can be found in 
a nunber of documented cases [L2: Prolingua, L3: CFPC, 
UK4! North Trafford College, BF5: VIZO, F5: CESI, F6; 
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GEIETA, etc . ] 



In same cases, the training advisory service and evaluation are provided In the 
form of a service by separate, multi -provider Institutions: 

In the case of a medl\im-slzed Irish food processor, although the analysis of 
training needs was undertaken by the management of the firm, this was "in 
consultations with tbe FAS Service to Industry Adviser. ... A FAS services to 
Industry adviser assisted the ccoppany executives In drawing up the plan. The 
adviser helped In the formulation of the training needs identification and 
recommended a cozxpetent provider. ... A tripartite relationship exists between 
the FAS training adviser, the ccnpany executives and the training providers". On 
this basis, objectives procedures were developed to suit the firm's needs. A 
cooperative evaluation by FAS, the training provider and the firm made It 
possible to acquire data on transferring what had been learnt Into practical \ise, 
and to employ fo rma l Instruments of evaluation available to the FAS and/or the 
training provider. 

"The formal Inputs combined with the workplace demonstrations and practice were 
very powerf\il and effective In ens\irlng a transfer to the workplace for the 
learners and the relevance of the formal Inputs to the providers" . [IRl] . 

Verein Weiterbildung Haraburg e.V. treats advisory services offered by the 
providers belonging to It as an explicit quality criterion. The advisory service 
Is not Intended to be directed at firms alone, but also relates to the individual 
participant. In the case study, a definition of the organizational prerequisites 
for the advisory service Is reproduced: "For potential customers, the possibility 
of an appropriate advisory service by informed eoployees must exist. Potential 
customers must also be able to Inspect the local lecture rooms/ training facil- 
ities before the start of an event. For each event, there Is one contact respons- 
ible; enough time Is available to discuss course-related problems. In addition, 
advice Is offered on more advanced training measures . " As a result of the 
advisory service activities. It Is found that the customers' judgements have 
became more competent and their wishes more specific. 



2.2.2 Ocxsperatlon in planning and implementation 

The emphasis here is on the planning and implementation 
of "tailor-made continuing training", even for small and 
medium- sized enterprises, at prices that can be financed 
and vdth adequate organizational forms. In addition to 
determining training needs, the needs coialysis must also 
tcdce into account the firm's financial and organizational 
limitations and, in that light, result in feasible 
curricula. 

In addition to the provision of flexible, CGinbinable 
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continuizig training modules , continuing training in S MEs 
also means the organization of combinations of learning 
locations and well matched coodbinations of providers o In 
particular, external s\;^3port for the workplace as a 
learning location, si^jport for self -instruction and the 
logical integration of manufacturer training courses into 
an overall learning concept are designed to make continu- 
ing training financially and organizationally practicable 
even for smsd.! and medium- sized enterprises. The use of 
coBxibinable modules helps to make the specific product 
easier to finance and organize. 

Quality assiurance in cooperation on the stage of joint 
planning and implementation must, then, guarantee 
appropriateness of continuing training aims, contents anrii 
methods, and also of the organization and financial 
practicability of the continuing tredning. Consequently 
the following questions should be put, as a minimum: 

■ Do the objectives and content of the continuing tredn- 
ing conform to the firm' s strategy, and are they 
conclusively derived from the analysis of training 
needs? 

- Do the learning and teaching methods conform to the 
objectives of the continuing training, and is 
content cui optimum vector for them? 

* Does the organization of the lecuning, in terms of Hm** 
and location, conform to the firm's objectives ar»H Hio 
needs of the participants? Has the right learning 
location been selected for the learning objective? 

- Are the costs of continuing training sufficient for *->»» 
project and si:pportable for the firm? 

- Are the external provider's and firm's continuing 
training personnel up to the job? 



■ Are other peurtners involved in the cooperation (train- 
ing providers, manu£act\irers, consTiltants) ? 

- Is the training provider in a position to undertake the 
necesscury advisory and planning work? 



2.2.3 Cooperation in evaluation 

The joint assessment and evaluation of the training 
measures, during and after the continuing training 
course, is used for quality assurance and the preparation 
of f\irther measures. 

This assessment centres on jointly devised success 
criteria \diich meeusure the success of the continuing 
training in terms of the practical implementation of vdiat 
has been learnt in the firm's routine work, eigainst the 
background of its objectives. In some of the documented 
cases, the providers of continuing training assume that 
the current instruments for measuring pcurticipant accept- 
ance, and tests oriented toward learning objectives with 
ultimate certification, cure of only limited interest to 
the firm. The tcurget of the joint efforts at evaluation 
must be at lecist a plausible link between continuing 
training and economic peurameters . Changes in the quality 
and productivity of work can be brought about 1:^ such 
shared levels of plausibility. 
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It Is apparent from all the documented cases, and from the expert* B judge m e n ts, 
that the eval\iatlon of continuing training activities is, naturally a central 
requirement of any form of quality assxirance in continuing training; but that 
this has been a weak point in previous efforts to improve and assure quality. 
Cf., for example, Joel Bonamy in the Anench study: 

"A second problematical aspect relates to the evaliiatlon of the tra inin g. The 
Intangible nature of the service and its effects, and the time frame within \diich 
they appear, have not it possible to identify satisfactory methods of 
evaluation. The effects of a training service are not directly observable, but 
became apparent only throuc^ the implementation of the skills acquired. They are 
thus difficult to separate from the overall effects of the productive environ- 
ment. Enterprises, then, fluctuate between evaluating the tra in er’s respect for 
his contractual commitment, which says nothing about the effects, and evaluating 
Indirect effects \diich provide little information on the relevance of the 
training. The difficulties of ex post measurement are likely to encourage the 
development of dynamic evaliiatlon, it possible to steer and adapt the 
training \q>stream, especially in the actual teaching process. The diffuse nature 
of effects of training artd tha problems with evaluating them have significant 
effects for the providers, especially as regards the justification of their 
activities” [F] . 



There Is general cigreement that a crucial evaluation 
criterion should be how much benefit the firm actually 
derives In terms of economic success from vdiat Is learnt . 
There Is equal Tinanimlty In pointing out the problems of 
quantlflably proving that continuing training produces 
such effects. In the ceises considered here, the practice 
of evaluation relies \:qpon a great many auxlllcucy con- 
structions, ranging f rcm measvnrement of participants’ and 
siq>ervlsors ' acceptance through test methods oriented 
toward learning aims, to attempts at roeasiirlng the 
transfer of the material learnt by questioning former 
peurblclpants and their sipervlsors after the event. 



However, there Is nothing wrong with any of these methods 
and Instrxmients provided that all those Involved are 
clecurly aware that each measurement Is only relative. 
Questions relating to participants' satisfaction with a 
continuing training mecisiure certcdnly prx^vlde Information 
as to participants' feelings about v^ther there Is a 
pleasant learning atmosphere, \diether they are happy with 
the content, lectiurers and media, etc.. But, of course, 
such questions elicit no Information on the quality of 
the content, the efficiency with \dilch It Is u^>6u:t:ed. 
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the applicability of \^iat has been learnt to the 
workplace, or even the econoDiic benefit \^ch the firm 
can derive from the trained enployee. 

One way of i n proving the defective efforts at evaluation 
certainly seems to be reviewing existing methods and 
instruments critically, to determine how well they meet 
criteria, and ccnibining them systematiccQly as a way of 
evaluating their coopliance with the maximum nuinber of 
criteria for continuing training quality. 

Evaluation in continuing training practice is usually not 
an end in itself, but is eoq)ected to serve as a constitu- 
ent of quality assurance, to optimize continuing training 
processes, to correct undesirable trends and to 
strengthen successes. It is directed at the fundaiaentally 
foxuiative nature of all efforts at evaluation in the 
context of quality assurance. 

The objective, then, is the earliest possible feedback 
between a continuing training activity and its evalu- 
ation. This is the only way in \diich undesirable trends 
can be avoided and luinecessary costs saved. Since, 
xiltimately, the transfer of learning to the workplace and 
the benefit to the firm that resxilts form this is the 
objective of continuing training, evaluation must create 
systematic opportunities for feedback between the real 
working world and the learning situation at the earliest 
possible stage in the learning process, and with constant 
repetition. 

An important element of such formative evaluation in all 
phases of the continuing training process is the self- 
assessment of participants, lecturers and managers. In 
particular, critical analysis of one's own skills, 
shortcomings and added coaipetencies as a resxilt of con- 
tinuing training by the participants in it is an ideal 
method for evaluation in the process of quality assxirance 
in continuing training. 
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2,2 o4 Systea® of ccqparati^ quiality agtorisae® 



In tbs idsal cas®, tbs coopsTution b©t«^©n fim smd 
training provldsr cfv®r tbs tbr®® stsgss r®f®rr®d to 
sbofuld b© stabilized as a fee^ack loop, and plssmed on 
this basis in tb® long tern. 



Establishing tbs cooperation as a long=tezm and sialti- 
diffitsnsional prcdiiiction/cons'iaption of serv’ic® can b© 
achieved tbrougb ©validation and follo^^^=i^, Ibis ©valu= 
ation highlights additional continuing training needs, 
etc, , 



Phases of cooperation between provider and SME 




Tbs stages of cooperation betifseen training provider snd 
as described, point to tbs need for the training 
provider to be able to provide additional advisory 
services , 

.Advisory services are a necessary part of tbs product, 
for tbs analysis of needs, for tbs pl anning and organ! z- 
atim of the tailored continuing training aeasure, and 
for its evaluation. These advisory services reqpire 
Issc^ledge of technology, iisork organizatii^, teaching 
techniques and social sciences. 





The French case of GRETA £st*Fssonne is relevant here: 

”3he effectB of the guali^ approach: This quality-based work has produced 
significant effects; it tends to transform the way in which training matters are 
approached, with a move away from an ^proach centred on the course and the 
satisfaction of the trainee and the client at the outcome of the course towards 
thoughts of a more ccmprehensive management of the system as a whole. After the 
preparation of the quality manual and procedures, a great deal of work remained 
to be done to establish the conc^t of quality. The internal instrumentation goes 
through a stage of activities vhich have to move beyond the reflex of an identity 
centred on the establishment to vhich one belongs, and became a joint 
enterpr i se/GKETA culture . 

This change in behaviour and mentality is also necessary in order to meet 
client's requirements. For business and government clients, an inportant criter- 
ion is speed of response. This calls for internal management, to ensure that the 
proposals match up with the real capacities the establishments can mobilize, and 
that implementation taJces place in such a way that the deadlines set by one side 
are ta3cen into account in the other side's action plans. For enterprises, in 
particular, this type of attitude by GRETA maJces it possible to establish a 
climate of trust to embark on a dialogue in vUch GRETA can play the part of 
consultant" [F6] . 



A number of questions are raised here regarding the 
professionalization of this new function in the training 
sector. Questions have to be answered about the qualifi- 
cation profile, the right curricula for creating this 
profile, and demarcations between responsibilities. 
Cleurifying the possibility of financing this advisory 
service is of ccnparable importance. Direct payment by 
the custcsner and hybrid financing via course fees are 
being tested. Matericds and instruments for supporting 
this cuivisory service have to be available. 



What has been said above means that continuing training 
providers, as partners in cooperative projects with 
firms, have to work jointly on the analysis of the 
training needs, the preparation and iaplementation of 
ted.lor-made curricula, and the evaluation of the measiires 
against the background of the firm's econGonic parameters . 
Ihe criterion for this cooperation is always the benefit 
to be gained by the customer - in other words, the firm. 
Such conc^ts of cooperation imply dreistic needs for 
restructTiring on the part of the providers of continuing 
training \dio are now active in the marketplace. The shift 
in their range of services away from the implementation 
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of measiires towards an advisory and £ollow-\q> service 
involves the providers in a new personnel policy and new, 
more flexible forms of organization tending towards 
process orientation. 



Curr e nt surveys of SMEs confirm this need. On the other 
hand, however, such processes of change are still being 
obstructed by treulitianal "academic orientations" in the 
Ccise of many providers of trsdning. Ihere is a need for 
new forms of cooperation between SMEs and external 
training providers, moving towsurds the concept of the 
"learning organization". 



Cbopoative rdatHMK betwem frainiiig provklers and 



with standard 
soninar maii«dn% 



Prouder 




.. wMi cooperative plannii^ and 
evahratim of amtinuing training 




In principle, the external provider in this case tcdces 
on the role of the career developnent/continuing tredning 
depeurtment in a leurge enterprise. In other words he helps 
to develop job-related leauming and assists these pro- 
cesses of learning and developnent within the organiz- 
ation. 
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This allocation o£ roles between SMBs and training providers can be Identified# 
In outllzie/ In the quality assurance efforts recorded In the documented cases of 
training providers. In Portugal, Spain and Greece It Is mainly the government 
Institutions lEFP, INQf QAED \dilch provide multiple services for SMBs. 

CESI GRETA In France also endeavour, as part of their customer orientation 
and Internal quality assiirance, to acquire the new conpetencles for the necessary 
services. Similar considerations apply to the cases of Prolingua and CFPC In 
Luxembourg. 

In Gennany, an attenpt Is also being made to establish a new conc^t of service 
among training providers by way of certification and/or self -monitoring on their 
part (CERTQUA and Welterblldung Hamburg e.V. ) . In the Belgian cases of VDAB and 
VlZO, this Is also the aim. 



Overall/ it becomes apparent that both government and 
private training providers are increasingly recognizing 
the necessity for these new fozms of service and cooper- 
ation and cure structuring their quality assurance efforts 
accordingly. 

This role, however/ can be taken over by external pro- 
viders only if they make major efforts to develop their 
organization towards integrated services/ custo m e r 
orientation and project orientation. The traditional 
product orientation/ with a prxxiuct range policy to 
match/ is beccaning increasingly obsolete on the continu- 
ing training markets/ as elsevdiere. 



The point of these remarks is to make clear the medium- 
and long-tezm development trends in vdxat business custo- 
mers will expect of providers of continuing training. 



2.3 Quality assurance in continuing training cooperation 
between firms and training providers 

From all the docnsnented cases of quality assurance in 
continuing training frcm the Meniber States involved/ it 
is apparent that cooperation between firms and external 
training providers is beccming increasingly important in 
the world of continuing training. This applies to 
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ccsntlnulxig training not only for large enterprises but 
also for small and medium- sized enterprises. 

Quality assrirance In continuing training/ In cooperative 
projects between firms and external providers/ natiirally 
relates to the same subjects and processes as It does 
within the firms themselves. Here again/ the aim Is to 
integrate the continuing training process into the 
strategic corporate aims, and accordingly . . . 

■ to ascertain training needs / 

* to draw up continuing training strategies/ 

- to define the content of continuing training/ 

* to define methods of Instruction and materials/ 

* to make available the human and material resources for 
continuing trcunlng/ 

- to arrange financing/ 

- to guarantee organization/ 

* to ensiure that the continuing training takes place/ 

* to evaluate the Intermediate and final resxilts of the 
continuing training. 

It Is also the function of quality assmrance In the types 
of cooperation that take place between firm and training 
provider to supervise and optimize the various stages of 
the contlnxilng training process and the overall process 
In such a way as continuously to ensiure and/or I m p r ove 
Its quality. A ccoipllcating factor In the cooperation 
between provider and firm Is that two partners with 
different InltlcLL positions have to deal with the same 
process . 
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* Large enterpriaea tend to solve this problem by 
thesnselves taking over the dominant role in quality 
assxirance, giving the training providers precise 
instructions in the £om a specification and themselves 
ensuring confoimity with that specification (the 
Renault case) . 

- SMEa are able to play this dcminant role only in 
exertional cases; they rely on external assistance in 
the processes of planning the continuing training and 
quality assurance. 

- Training providers tackle the problem in different 
ways: in seme cases, they thonselves endeavour to 
introduce quality eissurance measures into their cooper- 
ation with firms. In particular, providers with a 
strong background in the industry atteup^ ho analyse 
training needs in advance and to involve appropriate 
exp@^ knowledge from the firms in their own organiz- 
ation processes . Other training providers aim to obtain 
certification of their organization under standard 
series EN ISO 9000 or national standard, claiming that 
this is a way of preparing themselves for cooperation 
with firms. 



An exanple of a third possible line of development can be seen in the case GRETA 
Est-Essonne. This is the attesapt by a training provider to become regularly 
involved in regional net^^rka of firms and training providers, or to inspire and 
stimulate such link-\q>s. This approach seems particularly suitable for meeting 
SMEs* needs in respect of multidimensional information and continuing training. 
Here again, the training provider becomes the consultant and provider of services 
vdiich other institutions offer [F6] . 



It must be assumed, however, that apart from the docu- 
mented "model training providers", there are many trcdji- 
ing providers in Europe for whean "tailoring" is no more 
than a word and quality assurance an alien term. 

Whereas cooperation between large enterprises and train- 
ing providers will continue to be determined by the 
dominance and cosnpetence of the large enterprise in 



103 



105 



ccmtinuing trainizig matters, the installation of suitable 
forms of cooperation between SMEs and training providers 
(\diich is very uiportant for the European econcooy) needs 
further developnent work. To inprove the quality of this 
cooperation, and to provide quality eissurance, both 
partners need sr^jport in the form of information, 
practical reccBmendations, materials and instruments. 

These products of future developnent work should enable 
SMEs and training providers to set vp cooperative con- 
tinuing training projects and optimize their respective 
roles as peurtners in those projects. The documented cases 
and the jiidgements of the national experts provide, in 
the development and testing of suitable ed.ds for coopera- 
tion between SMEs and training providers, a possible 
field for (^lality cussurance projects in continuing 
training under LEQMASDO. 
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E. The role of the European standard series EN ISO 9000 
in quality managanent of continuing vocational 
training 

E . 0 Introduction 

Standards ENf ISO 9000 to 9004, etc., are being applied 
increasingly in Europe's manufacturing industry. This 
series of standards deals vdth the setting-i;^ of quality 
management systems. 

In many of the documented cases of quality assurance in 
in-house continuing training, this standard also plays a 
prcsninent role: 

- On the one hand, certification of firms in accordance 
with the procedural gviidelines of standard series 
ENT ISO 9000 affects questions of eaployees' continuing 
training. The internal application of the standard 
requires extensive training measures for the work 
force. In the case stiidies, this happens in the follow- 
ing cases: 





Itaae 


Cbuntzy 


Industry 


Of ISO 9000 


BFl 


ATBk N.V. 


Belgium 


W1 na ^ comun- 

ications technology 


yes 


E4 


Dragadoa y Oops truccionas 


Spain 


Building 


yea 


PI 


SOLLAC 


France 


Steel 


yes 


P4 


Renault 


France 


Motor 


yes 


XRLl 


7 


Ireland 


Food processing 


ongoing 


IRL2 


7 


Ireland 


Food producer 


ongoing 


IRL3 


7 


Ireland 


Printing paper 


planned 


ZRL4 


7 


Ireland 


Health care products 


yes 


LI 


ARBBD 


Luxenftiourg 


Steel 


yes 


L4 


Du Pont 


T^utftgfaourg 


Chemical 


yes 


(PI) 


Renault Portugal 


Portugzd 


Motor 


yes 


XJS3 


Wallcer Financial Solutions Ltd 


United Kingdom 


DP systems house 


yes 


DK4 


Hays Chemical Distribution Ltd 


United Kingdom 


Qiemlcal 


oaogoing 



- On the other hand, standard series ENf ISO 9000 also 
applies directly to continuing training services, and 
so affects the quality management both of in-house 
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continuizig training departments and of external train- 
ing providers . This relates to the following documented 
case studies : 



0 


Saae 


Country 


Type of training provider 


rar ISO 9000 


BF6 


VDAB 


Belgium 




ongoing 


P5 


CBSI -Normandie 


Prance 




yes 


(DB3) 


IBM Bildungsgesellscbaft nbH 


(Germany 


cr for firms 


yes 


(DB3) 


IW-Acadeny (Bavaria, 
Hanover/Saxooy- Anhalt, Hesse, 
Saxony) 


OexzoBXxy 




yes 


OR4 


The Oonpanies Institute fcnr the 
Industrial and Professional 
Training of their Staff (IVEPB) 


Qreece 




ongoing 


P4 


Renault Portugal 


Portugal 


Training departioent 


APtf 


OKI 


Bowles Outdoor Centre 


united Kingdom 


Outdoor education 


yes 


(nR4) 


North Traf ford College 


united Kingdom 


cr for industry 


ongoing 



TO Illustrate the use of EN ISO 9000 for quality 
asstnrance In In-house continuing training, we will 
stcurt with a general digression regarding the prin- 
ciples of ISO certification, and then describe the part 
played by ISO certification In Individual case studies . 



E.l Certification of the firms to EN ISO 9000 - effects 
In In-house continuing training 

In a world In \dilch mass mcurkets are changing to buyers' 
markets, cooDpetltlon between coaipanles In the manufac- 
ttnrlng and services sectors largely takes place through 
the quality of the products or services. Customary 
quality asstnrance procedures are based on spot checks or 
general quality Inspections. In such procedures, a 
reduction In the costs of complaints, customer cultiva- 
tion and service Is frequently offset by a proportional 
Increase In the costs of quality Inspection. Not only are 
the Inspection procedures themselves expensive, but 
defective products are not separated out until after 
manufactiure or even after fturther processing. The earlier 
In the production or service process errors are Identl- 



APQi Katicnal standard baaed on Standard Series BN ISO 9000 
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£ied and their sources eliminated, the lower will be the 
econcmic cost of ensxuring quality. From this stanc^int, 
many European fizms axe particuleurly careful in dealing 
with quality assurance matters in the actual developnent 
departments. In manufacturing industry, in peurticular, a 
pittr ihft-r of quality assurance methods have been developed 
which have been modified according to requirements 
(Peureto Analysis, ABC Analysis, Failure Mode and Effect 
Analysis [EMEA] , etc.). 



EM ISO Standarxl 9000 now provides a standardized, imifozm 
method, not dependent on the particular firm and product, 
which covers the organization of quality assurance. 
Certification by independent third parties that the 
standard is being applied in audits (based on 
EM ISO 10011, Parts 1 to 3) ensures the functioning of 
the quality management system and the customer's confi- 
dence in the quality of products or services. 



This series of standcurxis, originally formulated as a 
national British Standard (BS 5750) , was adopted in 1987 
1:^ the CEM (European Comnittee for Standardization) and 
introduced worldwide as ISO 9000 to 9004. It replaces 
various national quality assurance standards . Since 
August 1994, the term "quality management" has replaced 
"quality etssurance" as the central concept of this series 
of standards, which is subdivided into the following sec- 
tions [IRL]: 



• EN ISO 9000 
- EN ISO 9001 

• EN ISO 9002 

• EN ISO 9003 

• EN ISO 9004 



Guldellzies for selection and use of stan- 
dards 

Model for design/development, 

productlon/lnstallatlon and servicing 

Model for production and Installation 

Model for final Inspection and test 

Quail t/ management, quail t/ system 

elements 



• EM ISO 9004, Part 2 



The services standard 



- 0£ sxqpplementary in^rtance are standards ISO 8402, Part 1 (Quality vocabulary - 

International terms; ISO 8402, Part 2 (National terms), ISO 10011:1-3, and various 
national quality assurance standards \diich have not hitherto been harmonized on a 
European basis. 



EN ISO standard series 9000 Is not concerned with the 
quality featiires of partlculcur products or services. In 
the same way as traditional methods of input and output 
eval\iation, but defines the organization of quality 
assmrance - quality management - In a global perspective. 
As an open standard. It leaves It up to the iisers ' 
discretion to define the various criteria for product 
quality. Taking the custosners* requirements as the 
stcurtlng point. It describes methods of structural and 
procedural organization for ensuring the quality of 
products and services. The ISO standard thus starts frcm 
a process model of quality eussurance - errors eure to be 
continuously Identified and eliminated \diere they curlse, 
rather than at the end of the production process. 

From this stand^lnt, peurtlculcur iaportance attaches to 
the qualifications of the workforce at all levels of the 
organization. They have to know \diat Is required of them 
In their work and the relationship between that work and 
the firm’s objectlvei they must have authority to act In 
line with that knowledge; and they must be able to judge 
the results of their work from quality stanc^polnts . 
"Quality assurance" of production and services, within 
the meaning of standard series EN ISO 9000, Is therefore 
essentially defined as a question of motivation, qualifi- 
cation and quality awareness of employees at edl levels 
In the hierarchy. In order to comply with the require- 
ments and recommendations of this series of standards, 
the In-house training system or Ccureer advancement must 
be structured accordingly. The standards form the frame- 
work for the general objectives and procedural prin- 
ciples . 

For this reason. It Is not siirprlslng that the certifi- 
cation of firms Tinder EN ISO 9000 involves a major 
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training effort. EN ISO 9001 incliides "Training" as an 
independent quality feature (#4.18) for establishing and 
maintaining adequate qualifications for the \«orkforce. 
^ecifically, the following sets of tasks arise (cf. 
ISO EN 9004, Part 2, Section 5. 3. 2. 2: "Training and 

personnel advancement") : 

’ providing all eoployees with information and training 
relating to the firm's quality policy; 

- carrying out appropriate training programmes for all 
employees; 

- Ccureful verification of the qualifications needed by 
the personnel in view of the work \diich is being done 
or is to be done; 

- classification of employees' performance requirements, 
to take account of their development needs and capabil- 
ities (e.g. through employee talks) ; 

' the provision of training, in peurticular, to those 
employees ^/^ho join the firm, change their area of work 
or maintain contact with the firms 's external inter- 
faces, and an annual assessment of needs, budget 
planning and budget control; 

’ the docvnnentation, svpervision and evalviation of all 
training activities. 
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AIEA NV. , Belgium (Flemish ccmmunlty) , has had its production pTOcedures certi- 
fied under ISO EN 9001. This made it necessary to Introduce a continuing training 
plan for new enployees, or for employees changing their jobs. After the end of 
the course an evaluation sheet is completed, documenting the achievement of 
objectives in the EN ISO 9000 system. This exasple represents an ideal type for 
many certified firms: the gexxeral introduction of a quality management system 
means that the functionality of the training department for the firm is initially 
defined and then constantly €U3sessed. Quality assurance, therefore, relates not 
to the training department in isolation but to the interaction of the training 
department with the firm aa a \diole [BFl] . 

An Xrish food and tobacco processor with 32 enployees is currently setting up a 
quality management system under EN ISO 9000, in order to Izzprove product quality 
and produce the reject rate. The training processes necessary for the ISO 
certification Include an evalxiation of the transfer of the knowledge acc[uired 
into the working process. The mechanisms provided by ISO EN 9000 ensure that 
feedback from customers, suppliers and service providers is Incorporated into the 
training plans [IRLl] . 

In the case of the f^rench steel producer SQIiLAC, a description is given of how 
the introduction of quality management under ISO 9002 changes the perspectives of 
continuing training: 

"Integration of the training system into group quality assurance: ... While the 
new training rationalization policy was being established, all the factories in 
the group had to be certified to standard ISO 9002. The objective was to conform 
to customers' requirements, and especially those of customers in the motor 
industry \du> irpose even stricter standards. 

Certification was carried out independently of the human resources and training 
managements, because traditionally there was no contact between quality manage- 
ment and training management in this sector. The large-scale strikes in the iron 
and steel industry in 1970 had led managing directors to set \q>, alongside human 
resources (enployment, pay, training) , quality managements responsible for 
developing participation (motivation, management, etc.), in parallel to the union 
channel . However, ISO 9002 caused the works to specify their training needs 
(Chapter 18 of standard ISO 9002 contains a sosoevdiat Inprecise paragra^ on 
training) and refer to head office. 

Then the entire groiq>, including head office, had to be certified to ISO 9001. 
Consequently, the section on training had to be mad^ more specific. This was an 
opportunity to clarify responsibilities in the quality manual especially respons- 
ibilities as regards viho does ^duit in the matter of the respective coaxpetencies 
of head office and the works." 



E.2 Certification of trcLuiing providers and in-house 
training departments under the EN ISO 9000 standard 
series 

In more recent times, training providers and in-house 
continuing training depcurtments have not only been 
indirectly affected by the effects of ISO certification 
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of internal quality aianag@!ient syst®a®^ but bave also 
been certified directly tSi/saselwss , In tbe introductions 
to siany national case studies ^ reference is xsade to the 
special role of the ISO standard for assuring the quality 
of training prov'iders and training departssients o Quality 
management in the services sector, in other words includ- 
ing continuing training, is described in a separate 
standard (EM ISO 9004-2) . 

The certification of in-house training departments or 
training providers xjnder standard series EI7 ISO 9000 Ccui 
be summarized as follows: 

° It is the management of the training facility's quality 
assxirance that is certified, not the individual train- 
ing measxure. The certification thus regularly relates 
to entire firms or peurts of firms with ^^diich the 
training facility decLLs, not individual products or 
types of pioduct. The certification applies to the 
process of providing a service by a training institu- 
tion. Its successful granting means that the training 
institution is capable of cceiplying with self-imposed 
quality criteria derived from client's requireonents . 

° The requirements of the customers or clients are the 
centred, criterion for the quality of continuing train- 
ing. These requirements aire defined in a quality 
management manual on the basis of facts deter- 

mined by the managenent level of the training institu- 
tions. 

° Within the training institution, written quality 
guidelines are drarai and continuously i^pdated, 
containing introductions to and instructions on typical 
working procedures and process steps. The process 
regulations contained in manuals have to be inherently 
suitable for ensuring the quality of the training 
meas\ires. 
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As a rule, the elements contained in EN ISO 9001 are 
adopted as a structural outline o£ the description o£ 
the quality management system in the qued.ity management 
manual. These elements are: 



1 


Senior management responal- 
bility 


11 


Inspection^ measuring and test 
equipment 


2 


Quality assurance system 


12 


Inspection and test status 


3 


Contract review 


13 


Control of nonconforming products 


4 


Z>esign control 


14 


Corrective action 


5 


Document control 


15 


Handling, storage, packaging and 
delivery 


6 


Purchasing 


16 


Quality records 


7 


Purchaser supplied products 


17 


. Internal quality audits 


8 


Product identification and 
traceability 


18 


Training/personnel 


9 


Process control 


19 


Servicing 


10 


Inspection and testing 


20 


Statistical techniques 



These product- and service- independent gued.ity 
£eatures, evidently, do not directly £it in with the 
service o£ continuing tredning. Be£ore any certi£i- 
cation o£ training institutions, tliey first have to be 
••trans£erred" , meaning interpreted and siqjplemented in 
relation to the procedures cOid structure o£ a training 
provider or a training depcurtment. This trans£er has 
already been intensively discussed in various countries 
and resulted in success£vil certi£ications (e.g. DE, IR, 
UK) , \diile in others it has only just begun in the 
course o£ the £irst EN ISO certi£ications . 

The practical implanentation o£ the guidelines con- 
tained in the guedity manuals takes the £orm of organ- 
izational, hierarchiccd and qualificatory measures. 
Implementation is continuously reviewed in internal 
audits o External audits ttf independent third parties 
(generally assigned by a certification association 
\diich for its part is accredited under standard 
EI7 ISO 45012) take place before the granting of an 



^ ISO certificat®; axid from th®n on at about tbr®®- 
yearly intervals « 



In the Federal Republic of Germany there are admittedly, at present, more than 20 accredited 
certification centres imdertalcing audits under the standard series EM ISO 9000. The central 
associations of German Industry founded CERTOUA GabH as a certification centre for training 
providers and In-house training departments with a specific view to the needs of vocational 
and In-house training. CERTQOA's objectives are documented In the German csise study. CERTQ^ 
has adopted the objective of Incorporating the special framework conditions and requlrenents 
of non-state -regulated vocational training Into Its certifications under the "product-neutral” 
EN ISO standard, llils objective Is also of Interest to training Institutions associated with 
large enterprises, most of vdilch have hitherto been, as It were ”co-certlfled” In the course 
of the certification of the \diole enterprise by auditors outside the training sector, and 
often have no opportunity to Introduce educationally grounded quality assurance methods Into 
the EN ISO procedures. The work done by CERTQ^ Is currently (December 94) In Its initial 
stages, so that no practical experience can yet be reported [D3] . 

A clear and detailed description of quality assurance by certification of a QM system under 
EN ISO 9000 Is to be found In [BF6] : 

In 1993, the managenent of VDAB, a Belgian training Institution, Introduced a quality assurance 
prograxnne vAilch was aimed at all the approximately 700 lecturers. Until the programme had been 
coopleted, the quality of courses was to be ensured by their centralized developonent and 
distribution. However, the size of the Institution meant that the uniform quality of the 
continuing training products could no longer be guaranteed by a centralized controlling 
office. "In order to master the non-quallty-prdblsns ..., good-vrlll, crisis management, 
training programs, and seminars are not sufficient. In a large training-institute as the VDkB, 
that operates In different regions, a well defined Quality filanagement System Is needed. As 
guide and instrument, VDAB-management chose for the ISO 9000 series, as a standard that 
controls (control: to know iidiat happens, know ^diat to do, 'mastering') of the management of an 
organization can be established by having a documented policy and supporting procedural 
instructions vAilch define resposisibilitles and actions of everyone whose work inpacts of the 
service provided.” 

For the purposes of Inpleanentatlon In the continuing training sector. It was initially 
necessary "to define the customer and all parties \Aio are affected by the service being 
provided: the students ..., the company vtho pays for the training ..., the 'users' of the 
trained students ...” 

In a quality aystem, responsibilities for the planning, inplementatlon and follow-up of the 
couurses and the conpetencles of the various departments were defined. *nie form and Informatory 
content of training products was defined and structured ("Contract Review”) . Quality control 
of the holding of the course required not the definition of Instructional principles and 
course contents but the definition of procedural rules for selecting lecturers, expert reviews 
of the curricula and the nodularlzatlon of the content. Quality problems can be traced through 
the written documentation by the trainer of all successful stages in the participants' 
learning ("Traceability”). In every course, the participants' entry qualifications and, 
ultimately, results of learning are recorded ("Inspection and Testing") . All these records are 
discussed with the participants and the consequences ("remedy, next st^, corrective action If 
the result Is not successful") are discussed jointly with them. 

The quality progransne under EN ISO 9000 was designed with the participation of working peurtles 
of lecturers: these working parties produced course descriptions and evaluation sheets. It was 
regarded as an important factor behind the Qi system that the lectinrers idiich were to apply It 
had been Involved In Its planning. The first audits took place around November 1994; 80% of 
the lecturers were prepared for the external Initial audit at that time. 

VDAB regards It as an advantage of EN ISO certification of continuing training services that 
the quality policy Is recorded and s\:q3ported by all participants, not In a non-binding form 
("pep talk") but in terms of precise and quantifiable categories. In addition, the attention 
of the management Is called to grey areas and unclear responsibilities idiich may adversely 
affect quality. Because the EN ISO standard series 9000 defines procedures and not contents, 
adequate scope Is left for the necessauy creativity on the part of the training provider. 
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Alignment with the EN ISO standard series offers the 
great advantage of being accepted in manufacturing 
industry and being industry-ccsipatible , Ihe ISO standard 
seems suitable for a number of reasons as an operational 
framework for qucQity assurance in in-house continuing 
training: 

- It requires the setting of objectives for continuing 
training and indicators for its success, and so ensures 
the transpcurency of the continuing training for the 
pcurties involved. Possible conflicts of objectives 
between leemiing and working processes thus beccme 
apparent at an early stage and can be adjusted if 
necesscury. 

- It considers continuing training not as an isolated 
process but in the context of the firm's (^lality 
objectives. It thus meets the requirement linked to the 
internal integration of working and learning. Ihe 
internal learning process is considered not in itself 
but as an element of production. 

° Because of its Europe-wide validity, the W ISO stand- 

eurd series can be a means for creating European com- 
patibility of quality management procedures. It will 
not standardize such procedures or the content of 
quality criteria: but it ensures that discussion of 
quality assurance in continuing tremiing uses the same 
terminology and clcissification, and the documentation 
requirements associated with its use improve the 
reproducibility of quality assurance meeisures for third 
parties . 

At the same time, the formalism of the ISO standard is 
notable. "Certification under ISO is thus not a tradi- 
tional form of quality cissurance, in vdiich the quality 
standards of continuing training or the end product have 
been assessed in term^ of content. The standards on ^f^iich 
ISO certification is based relate not to the contents of 
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the standards but eKclusively to the loethod" [D] . Because 
it is open to any type of production and service^, the 
standard is a jaere inethodolc^ for quality asanagenent . It 
needs to kno«^ nothing about the specific product^, and so 
does not require criteria^ indicators or specific e^mlu- 
ation msthods to be derived. However suitable it appears 
as a procedur2Ll standard for in-house and vocational 
continuing training, it is still no substitute for the 
preparation of content and methods for the evaluation of 
job-related continuing trcdning. 
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For exanple, the Belgian study on VDAB reports: "The first challenge was to 
translate the requirements of ISO into the product: training. ISO standards and 
guidelines have been developed primarily for supplication in product organis- 
ations. The outcome of training is incresusing knowledge, skills anrii attitudes" 
[BF6] . 

And the German study stresses the service provided by CERTQOAi "ISO certification 
requires a transfer of the ISO standards in question to the sector of vocational 
training. On the bsisls of standard DIN ISO 9001, CERTOfOA has described the 
requirements to be met by a quality management system for training providers in 
20 individual ele m e n ts or modules. It has converted the standard of a quality 
management system, as it exists in DIN ISO 9001, for the sector of vocational 
training" [D3] . 

In the case of the French training provider CESI^Nozmandie, we have one of 
documented EN ISO certifications of training facilities in France. In addition to 
the problems described, relating to the transfer of abstract standards into 
continuing training- related procedures (the evaluation problem, for example, 
not yet been satisfactorily solved) , this case also reveals an enormous effort in 
terms of cost and organization: 

"The functioning of quality assiurance 

Time spent: From February 1991 (first thoughts) and 1 March 1993 (certification) . 
The time spent has been allocated as follows: 

1 year for basic research into the application of the ISO standards, 

2 years to establish quality assurance: definition of the quality system, 
installation of the system, 6 to 9 months for testing adjusteent. 

Resources enployed; 

* ^le pilot comnittee, ^dxich replaces the steering comnittee and xneets once a 
month. 

Detachment of a consiiltant for 1/3 time. 

Writing of procedures. 

Costs; between 800 KF and 1.2 MEMF, depending on t he method of csd.culatlon. 

Dally operation requires a quality officer (1/4-time) , and two internal auditors 
vho are retired members of the Board of Meuiagement «Tid each contribute 10 days' 
work per year (or about 500,000 FF)." 

This is one of the main reasons why Joel Bonamy concludes that ISO certification 
will remain "elitist", if it is aimed at by only a few training providers in 
France [F] . 



For example, in the case o£ a ccmtplex service such as 
continuing vocational and in-house training, it is not 
clear vihat should be defined as a "custcaner requirement’" o 
^^>art from the fact that it is often difficult to ident- 
ify the client (is it the client enterprise as a vdiole, 
a personnel or training department, the individual 
participant or a public institution sponsoring the 
training, each of \diich may have different and conflict- 
ing quality e^ectations?) , it can be said that the 
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clients thesnselves often have only vague notions of the 
objectives of training. In many of the docaimented cases 
deteroiinizig the objective is not a prerequisite but the 
first part: of the interactive process between the train- 
ing institution and the client ("training advisory 
service") . Such problems of adaptation also arise at 
other points of the application of ISO 9000. 

In seme case studies, therefore, another question also 
raised is ^diether the certification of in-house con- 
tinuing training \jnder the ISO standards does in fact 
actvially contribute to inproving the quality of the 
continuing training. The fact is that all case studies 
^diich refer to EN ISO 9000 mention it only as a frame- 
work, an organizational regulation of quality assurance. 
In no instance does it replace eQ.1 the methods and 
instruments for evaluating the content of the training, 
vdiich are referred to in many Ccise studies. To this 
extent, the EN ISO certification will not put an end to 
the debate about quality assurance and quality management 
in training institutions; it is merely a formal aid to 
cissuring quality in continuing training, whose defini- 
tions of content (quality criteria, indicators, evalu- 
ation procedures and instruments, optimization methods) 
have to be derived elsevdiere. 
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In the case o£ Spain, the attitude o£ training providers to ISO certifications is 
reported to be largely one of rejection. Bxmav&r, Pedro Cordova asks critically 
whether this attitude does not arise from traditionalism on the part of the 
training providers, resulting ^dierever possible in interventionist action by the 
State, if the inadequate efficiency of the continuing training results in 
wastage of resources in the long term. 

"Cbntroveri^ regarding certification or standardization: The practice of quality 
certification of training institutions has not became established in Spain as it 
has in the other countries. More than that, the possibility is contenplated with 
extreme reluctance, especially by the actual establishments coxicemed. Is 
reason a more convenient situation for professional activity? Is there not too 
such risk, during this period, of seeing wasting of resources frustration of 
expectations, and the degradation of image of training? Is not this a serious 
diluted irresponsibility, given that, in view of the cosplexity and difficulty of 
mastering the aspects of measurement or verification schemes ^diich relate to 
human resources within the organization, there has been neglect of the use of 
systematic approach methods vdilch would make it possible to obtain sxifflcient 
information to validate and decide upon the effectiveness or relevance of the 
process or the options?" [E] . 



In addition^ there are many other problems to be over- 
CGone; vdiich will make it more difficult to introduce 
quality management methods under EE? ISO 9000 in the case 
of training prxTviders than it is in the case of manu- 
facturing industry; 

° Problems arise with the determination of the quality 
concept with regard to the factors of continuing 
training^ with the Ceurrying out of audits, and with the 
necessary definition of quality indicators for the 
service process. Continuing training is not a service 
provided in identically repetitive and clearly struc- 
tured ways, but is siibject to constant change in 
respect of its content and methods. 



- Quality assurance procedures also affect surrounding 
areas; for example, in particular, questions of con- 
tract law and - within training departments and train- 
ing providers - labour law have not yet been 
universally clarified as regards the certification of 
continuing training services. 

" Many of the continuing training providers described in 
the case studies act for different clients with quite 
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different objectives, e.g. for governmental or public 
institutions (such as ministries, labour agencies and 
socieJ. institutions) , for firms and for individuals . 
Certification of the provider as a vdiole rather than of 
individual training products presiqsposes possible 
problematical generalizations of their requirements . 
Interference with the in-house quality standards and 
regulations of seme clients also have to be taken into 
account . 

- ENf ISO certification prest^sposes an increased e3q)endi- 
txire for the training providers: in particular, con- 
vincing indicator and documentation systems have to be 
developed and maintained vAiich uprove the transparency 
and reproducibility of the service process. It remains 
unclear \diether this increased e9q>endit\ire can be 
successfully financed through market prices or budgets 
at a time \dien, in relative terms, training budgets at 
many European enterprises are declining. 

- The certification offices accredited in Europe hitherto 
mainly operate in the industrieJ. sector and have less 
experience with the certification of training pro- 
viders. This creates the daxiger that the steuidards will 
be applied bureaucraticcJ.ly. A few years' experience is 
necesscury to determine \diether specicJ.ized certifi- 
cation offices for continuing training, such as have 
been set in some Member States, will effectively 
help to improve the quality of the content of the 
continuing training provided by training depeurtments 
and training providers, through particular specicJ.ized 
skills . 
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3. Quality assurance cuid structxiring in the continuing training 
market 



3.1 'nie continuing training market 

In all nine Member States of the Eurppecui Union from ^^ch case 
stu d ies have been obtained, individuals cuid firms eure sv^lied with 
continuing vocational training services primarily through market 
relatiana. In contrast to vdiat happens with the basic vocational 
training system, which to veuying extents features direct govern- 
mental regulation, in the sector of continuing vocational euid 
in-house training the states confine themselves to setting framevrork 
conditions, intervene through institutions of their own which cu:e 
concerned with vocational training, cuid exert a controlling effect 
on the market as a resiilt of their inportance as customers in the 
continuing training ntcurket. 

The principle of the open market for vocational or in-house 
continuing training is - depending on objectives in terms of 
economic cuid training policy, economic cuid socied. framework 
conditions cuid preconditions on the side of basic vocational 
training - implemented in different ways euid with different resiilts 
in the nine states, but Ccui be Sed.d to be a fundcOoentaLL principle, 
in contrast to the case of basic vocational training. 



"In Greece there has to now been established an uniform formalized system of 
continuing vocational training. ... A coioplex network of public and private 
agencies has been set up offering vocational training to eoployed and unenployed 
persons that is being developed side by side but clearly taken apaurt from the 
formal vocational training system. ... In this context as no approval or recog- 
nition of the State is required by the providers the continuing vocational 
training market is open and is characterized by the multiplicity and diversity of 
suppliers and supply and by the subsidiary role of the State. Among the continu- 
ing vocational training providers are included: 

* Public authorities and State controlled organizations 
‘ Uhiversltles and educational institutions 
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* Professional associations and chanibers 

* Organizations set \jp by eaaployers* and employees' unions 

* Regional and Local authorities 

* Private human resources development and training agencies” [GR] . 

"Training provision in Ireland can be divided in three distinct categories: 

* Initial and continuing training for the unenployed 

* Training for the re- integration of the socially excluded 

* Training for the employed in industry 

The first two categories are catered for by state funded training centres and 
cominunity based workshops and by externally contracted private trainers . ... 

Training for the enployed is provided by a variety of in-house trainers, part 
time and night-courses in state operated training and education providers, 
private training companies and consultants working on and off the job. [IRL] . 

"The sector of continuing vocational training in the Federal Republic [of 
Germany] is clearly separate from that of beisic training. This is expressed both 
in the statutory regulations regarding continuing training and in many continuing 
training product ranges, most of ^diich require qualifications to have been 
obtained in basic training. The continuing training ' system' has, since the 
Second World War, been structured quite differently in the Federal Republic from 
basic vocational training. In some sectors of continuing vocational training, 
especially in the last 10 to 15 years, a svqpplier structure has developed vhich 
bears the stamp of a market economy. In the course of history, the variety of the 
continuing vocational training system has given rise to different forms of 
quality aissurance ^diich are only valid and jtistified for the part -sector in 
question. ... What this means for the structure of continuing vocational training 
is the following: in the Federal Republic of Germany, continuing vocational 
training is relatively \mregulated by comparison with basic vocational training, 
^diich is regulated by the social p 2 u:tners and the State . ... Continuing voca- 

tional training is therefore non-uniform from the structural standpoint, consist- 
ing of varioiis segments in ^diich governmental responsibilities and training 
market combine in different ways. ... In the Federal Republic, continuing 
vocational training is clearly separate from the basic training system. . . . mie 
market economy sector of continuing vocational training in the FedersG. Republic 
is characterized by the 'pluralism* of the various srqppliers. ... This competi- 
tion [includes] the following srqppliers: enterprises (private industry, public 
service), governmental, municipal and public law providers (e.g. universities, 
adult education centres, chanibers), employers and unions (e.g. industrial 
training systems, the continuing vocational training system of the DGB [German 
Trade Union Federation] , training system of the DAG [German Salaried Staff 
Union])# vocational associations, professional associations (e.g. Association of 
German Engineers, Association of Industrial Economists, Federal Federation of 
Industrial Foremen's Associations), private ccmmercial/non -profit-making training 
providers" [D] . 

The report on France states: "Uhcertalnty as to quality can be traced back to the 
origins of the continuing training system \diich was established under the Law of 
16 July 1971. That law made it obligatory for enterprises to participate in the 
financing of vocational training by allocating a given percentage of the wage 
bill to it. 

At the time the law was in preparation it had been realized that proposing to set 
i:p a vast training market, funded by an obligatory contribution from employers 
idiereas operators were relatively few in number, would necessarily generate 
tensions. In fact, the need to prompt additional operators to embark on this 
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activity, in the Icnowledge that to be ccmpulsory eoployer participation would 
have had to rise froon 0.8% to 2% o£ the total wage bill between 1972 and 1976, 
was to restil t in quanti ty being given priori ty , as it were , over a niore 
harmonious development o£ training activity. It was for this reason that bodies 
wishing to operate in the training market were subjected to only a Tnlnlimim of 
rules for the carrying out of their activities. These rules are confined to 
registering their intention to enter the market (declaration of existence) and an 
a posteriori description of the activities they have carried out (instructional 
and financial stock-take) . 

Today, the available vocational training service is characterized by being 
distributed or fragmented over a great many training bodies. In fact, the Law of 
1971 instituted the right of any legal or natural person to carry out this 
activity. This opening-iqp of the market explains ^diy most of the participants 
merely diversified into it, their main activity not being training. Only 15% of 
the bodies concerned earn the majority of their turnover from vocational train- 
ing" [F] . 



If the continuixig training market is divided into seg- 
ments, classified by the respective clients, we find - 
disregarding national peculicurities for the moment - 
characteristic forms of market relationships and govern- 
mental intervention: 



Continuing vocational training for firms 

In-house continuing training takes place in all states 
reported in the case studies, largely free of direct 
governmental or public interference. It is carried out 
in the context of private-law contractual relationships 
between training providers and firms, or in the context 
of the internal division of work by training depeurt- 
ments. In some Member States, statutory regulations 
ensure a certain miniimim of in-house trcdning [E, F, 
GR, P] , or in-house continuing training is publicly 
sponsored in certain regions and sectors or for small 
and medium-sized enterprises. 

Continuing vocational training for private, individual 
custcaners 

Continuing training measures for private customers 
\dio want to maintain or improve their professional 
opportunities are also agreed in the form of service 



cont3racts with tz'aixiing' providers . In the continuing' 
training market# providers iise advertising media to 
recruit potentied. private custcmers for trai n i n g . 
Govezrnnentcd. regulations in this sector - vAiere they 
exist - are mainly concerned with consumer protection. 
In seme states# employees have a statutory right to 
continuing training# intended to preserve their capac- 
ity for work [E# F# P] . 

- vocational training in the context of social 

and labour market policy 

^le case st'udies# and supplementary material from 
CEDEFOP# reveal that continuing vocational training is 
increasingly being used as an instru m e n t of social# 
regional and labour market policy. All nine states 
therefore have authorities and publicly controlled 
inistitutions vdiich initiate# promote and control 
continuing ’vocational training to serve the interests 
of these policies. In some cases# these institutions 
eure not themselves involved in supplying training on 
t-hft continuing training market# but act as custo m e r s to 
those that are. The free market concept is thus 
retained in principle# but considerably affected by 
sponsorship and subsidies: sijxply as a result of the 
wide extent of public demand# relative to the market 
relationship between individuals# the continuing 
training market is structured and its content oriented 
in a specific way. 

Quality assurance in continuing training regularly has 

effects on market mechanisms. However# only intervention 

in accordance with market principles can ensure that . . . 

* quality assiurance systems on the independent responsi- 
bility of those involved - as participants or suppliers 
- ixi continuing training beceme established instead of 
state -regulated quality control systems; 
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* questions of quality assurance in continuing training 
are not confused with questions of the certification of 
continuing training or new market structmre models; 

* the quality criteria \diich individuals and firms eoq>ect 
continuing vocational training to meet eure reflected in 
qucdLity ysurdsticks with c^ropriate content; 

- and that the wide variety of activities pursued 
training providers and in-house tredning departments 
are not curtailed external quality yardsticks, and 
that the rapid reactions and flexibility of the con- 
tinuing training system eure retained. E;q>erience 
suggests that the state-plemned si;^ly of trcdning 
requires long periods of prepcuration, \diich would not 
be adequate to meet the rec[uirements expected of 
continuing vocational and in-house tredning, \diich has 
to keep pace with a very rapid technological and 
organizational change. 



3.2 Quality assurance in the continuing tredning 
market 



3.2.1 Quality criteria 

In line with the wide variety of peurbicipants and inter- 
ests to be found in the continuing tredning market, the 
criteria and instruments of quality assinrance in continu- 
ing vocational training axe more differentiated at 
the level of the individual firm or provider. 

In the case studies cdone, therefore, the following 
general objectives of continuing vocational training are 
mentioned, and quality cissiurance in continuing tredning 
must relate to these: , 




. 'a 'r 




124 



- Appropriate provision of continuing training services 
to industry and individuals 

• Si:pport for technologiccd. development 

• Ensxiring the transpcurency of the continuing training 
ntcurket and the ccaxpcurability of available continuing 
treUJiing services; consinner protection 

- Flexibility of the continuing training market 

- Ensxiring the vocational integration of particular 
tcu?get groups (the unenplpyed/ the handicapped/ those 
threatened with exclusion) by continuing vocational 
training 

- Support for regional development through continuing 
vocational training 

The list could be extended - but the disparity even 
between these objectives shows that quality criteria in 
continuing training must be able to be derived frcoi quite 
different and in some cases conflicting yardsticks. 

In contrast to in-house continuing training, vAiere there 
is a cleeu: emphasis in the quality assessment on trans- 
ferxing \diat has been learnt into practical application, 
the case studies therefore say little edsout the deriva- 
tion of quality criteria in continuing training at the 
macro- level. Where such criteria cure listed, the case 
studies relate to public training institutions or those 
supported by associations. 



3.2.2 QucLLity assurance mechanisms in the continuing 



If we consider the sector of the continuing training 



tredning market 
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market v^iich. is relevant for enteirprises/ a- distinction 
can be made between sources of quality assurance. Quality 
can be ensured by . . . 

* market mechanisms 

* measures to inprove market transparency 

- self-monitoring by training providers 

* certification of recognized final qualifications 

- contractual regulations and specifications 
’ multi -provider standards 

’ direct and indirect national and/or European support 

* direct euid indirect national and/or Eluropean legis- 
lative intervention 



3. 2. 2.1 Quality cussmrance eis a result of market 
mechanisms 

All the case studies report the existence of numerous 
suppliers euid of competition in the continuing 
market. The suppliers are independent training providers, 
professional associations, regional or sectoral 
industrial associations, union training providers, 
chamber training providers, sxjbsidized or governmental 
providers and training departments of large enterprises. 

J^art from price, the quality of the training measures is 
an essential means for market success. In some case 
studies [D, GR, UK] , it is explicitly assumed that an 
adequate, flexible and high-quality supply of continuing 
training services to individuals and firms takes place as 



a result of nerket mechanisms. The marketing of training 
has a reciprocal effect on the quality of the training 
measures . 



The German case study, for exanple, reads: "The system conc^t of the nineteen 
eighties featured the objective of an open continuing training market. The market 
was expected to supply the existing demand for high-quality products. In tliis 
conc^t, governmental activities were subject to the principle of subsidiarity, 
according to \diich action by goverxxments is only justified if the tasks in 
question cannot be achieved by private forces and the financial resources of 
those concerned (e.g. assistance to problem groups under labour market policy) . 
In this phase, the enterprises, too, become irportant as training providers. ... 
In contrast to other areas of the training system, continuing vocational training 
is particularly characterized by the fact that it is significantly Influenced by 
the organization of the market econosy. According to the public policy objective 
of an open continuing training market, various suppliers of continuing training 
services enter the market (supplier pluralism) . As coopared with other sectors of 
training, the statutory rules and standards in continuing vocational training are 
less conprehensive. The state ijxposes framework conditions for continuing 
vocational training, \diich have to be ccoplied with by those operating in the 
continuing training market . However, it also takes action on the basis of 
subsidiarity, vdien certain continuing training functions cannot be supplied by 
private sxppliers" [D] . 

"The UK (aovemment does not feel that it is the best placed to determine vthnt 
skills are needed within the training market. It feels that business and individ- 
uals are able to forecast their own emerging skill xieeds and decide how these 
should be met. ... The primary role of the UK Government is to ensure that the 
training market has the capacity to identify and adapt to demographic, techno- 
logical and economic change. . . . Its role is to create the right climate in idiich 
businesses may flourish" [UK] . 



On the other hand, scane Ccise st\idies point out that, in 
the training sector, scsne restrictions on a fxmctioning 
mcurket mechanism have to be accepted and quality assur- 
ance thus does not autcmatically result frcm ccnpetition 
between the participants in the market. 

Included among these functional defects in the continuing 
training market are: 

- habalancea in the supplier structure: tredning provi- 
ders subsidized goveznment or associations have an 
irpact on private providers . Market structures are 
lacking. 
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"Ultimately however the contlmilng vocational training market is being 
inadequately and asyxDmetrically covered in maxiy matters due mainly to the lack of 
specific offer and demand structures" [GR] . 



- Quality in continuing training is brought about in a 
relational process between participants and the train- 
ing facility - the participant contributes his pairticu- 
lar existing qualifications; to this extent, qued.ity 
cannot be positively defined merely eis a property of 
the provider's services. For many of the training 
institutions described in the case studies, then, 
"customer orientation" is regarded as the dominant 
guideline of their quality eissurance - but at the same 
time this guideline is only methodological and needs to 
be supplemented specif iceQly for each Ceise. 



In the French study, the following canment is made on the problem of market 
transparency: 

"The question of quality in vocational training has became steadily more pro- 
nounced. The ixq>osltlon of controlling rules has not really made it 
possible to ensure the transparency of a market vhlch is often regarded as opaque 
even by those vdio are active in it. This xincertainty relates not to the training 
itself or its \asefulness, hat to its production - in other words to the training 
bodies which siipply it and to their relations with the tr€iinees. By the Law of 
1990, the legislator organizes the relation between the training body and the 
trainees and lays the groundwork for a "consumer right" relating, in particular, 
to the teaching contract. 

In order to characterize the current situation affecting the case studies, a 
brief account will be given below of the changes in the position of the main 
participants (the enterprises as customers for training; the state as the 
regulator of the market; and the training bodies as the s\q)pllers of training 
services) relative to the question of quality and the various routes they have 
taken in order to be able to guarantee the quality of the training \dilch they 
produce or consume. To conclude this first section, an effort will be made to 
sunmarlze the contributions made by the case studies to the factors extending the 
quality approaches" [F] . 



.Nbn- transparency of the continuing training services 
and the continuing training market as a whole: the 
quality of continuing training services is more diffi- 
cult to assess than that of material products or other, 
less complex services. In culdition, custcmers have to 
evaluate the quality ex ante with reference to informa- 




128 



tion documents and consiiltancy discussions. 



Itie German study reports: "As the organized continuing training market, based on 
a market econony, has escpanded In recent years, purchasers In this sub- segment of 
continuing vocational training have been faced with new uncertainties and risks 
regarding the quality of the product. This problem has resulted In controversy 
about quality assurance concepts In continuing vocational training. . . . The wide 
variety of the continuing training available has resulted In a lack of trans- 
parency for the consumer of continuing tra in i n g" [D] . 

And th f* Spanish escpert Pedro Cordova has this to say: "But the need to Illuminate 
and clarify the training market Is even more urgent. During recent years, a very 
copious supply of training hag come Into existence In Spain, often acccnpanled by 
very aggressive marketing, which makes It difficult to choose between the most 
appropriate programmes or services. In addition, the Impleme n tation of the 
National Continuing Training Agreement, with substantial resources devoted to 
financing training programmes, has caused the appearance of a large number of 
small training a nd constiltancy Institutions or enterprises which want to share In 
the distribution of these funds. Making decisions on the purchase of training 
services or programmes proves ccnplex and difficult, especially for those 
enterprises or Institutions \dilch have, to a substantial extent, professionalized 
the In-house training fxmctlon or \dx> lack a training organization equipped with 
adequate methodologies and criteria" [E] . 



* Custconers of continuing training - both individuals and 
enterprises - are often not ccescpetent customers: they 
lack the criteria to assess their need for continuing 
training services and to evaluate them. Uncertainties 
as to quality may be assimed, especially in the case of 
less pre- trained and independent individual custcaners 
and in the case of smaller and medium- sized enter- 
prises . 

Reference has been made in [Chapter 2] to a two-sided 
development in the market relations between enterprises 
and training providers: 

- On the one hand, providers of training to large firms 
cure increasingly converted frcm the start - in the 
large firm's planning and training departments - to 
mere suppliers of precisely defined continuing training 
services. In such cases, the training provider is now 
hardly required to provide independent services of 
needs assessment, training planning and success evalu- 
ation. 




* On the other hand, new forms of cooperation are 
developing between training providers and small and 
medium- sized enterprises, in vdiich the training provi- 
der offers his own services to make good the small or 
medium- sized enterprise's deficiencies in training 
organization, vocational training and evaluation 
resources, and these services provide backi^) during the 
ijxplementation of trcdjiing measures. 

As regcurds the development of market structures, the 
first alternative initially appecurs to pose no problems: 
defined and hence marketable services are offered and 
bought. The question must arise, however, of \diether the 
separation of training providers from the identification 
of demand and evaluation of measures may not hipair the 
quality of the continuing training service in the long 
term. At present, the training providers find out about 
the resiilts of need analyses and evaluations largely 
through market relations cQ.one - in other words, through 
the fact that their seminar proposcQ.s are accepted or 
certain modifications cu:e required. But quality cissurance 
in the market for continiiing training for firms requires 
that the separation between st^spliers and customers is 
partially overcome: in so feu: as continuing training is 
organized as a service in a free continuing training 
market, those vdio provide it act outside the sphere of 
working activities. Criteria of curriculian design and 
teaching concepts, and irplementation, are thus not 
produced by direct access but are transmitted. The 
process of quality assurance, in other words the rela- 
tionship of continuing training work to the working 
world, would therefore have to take place in a separate, 
continuous feedback process. Quality cissurance methods 
for continuing training in large enterprises have to be 
measured against whether they encourage this feedback to 
the training provider. Conversely, quality assurance 
methods within the institution that provides the trsdning 
not only need to be implemented internally but must be so 
designed as to be capable of reaching out to the custo- 
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In the relationship between training providers and SMEs 
there are more fundamental problems : the cooperation 

between the provider’s personnel and the SME during the 
analysis of needs, the planning of training and, after 
<->!« isplesnentation of training measiires, the evaluation 
of the training makes it difficult to separate the 
contributions of firm and provider. The services of the 
training provider, however, have to be econcsnically 
quantified so that they can be financed via the market. 
In addition, the willingness of SMEs to pay extra for 
adaptation to needs and quality assurance measiires in 
continuing training is not generally very great; such 
services are regarded, if not as actually superfluous, at 
least as inexpensive and a matter of course. For SMEs, 
focus is on the ixaplementatian of the training 
measures, draining providers ^dio are unwilling to 
renounce the evaluation of their methods completely 
usually resort, in this situation, to minimalization of 
the evaluation (for exanple on participant question- 
naires) or cost their expenditure into the market price 
of the courses. This, however, makes marketing the 
^-raiTi-ing ’ difficult for providers vdio not only want to 
sell standcurd seminars but also intend to provide back-xp 
measures in the evaluation of needs and results : their 
programmes are more costly. To this extent, functional 
quality assxirance in continuing training services for 
SMEs, financed through the market, presxpposes a new 
awareness of training on the part of the enterprise. 



3. 2. 2. 2 Quality assurcmce as a result of measures to 
iaprove market transpaurency 

^le lack of tremspeurency regarding the available continu- 
ing training services and the fact that many training 
customers are xjnder- informed have meant that information 
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and advisory facilities have become an essential of 
quality assurance in the continuing training market. 

All the case stiidies report on advisory services offered 
by the training institutions themselves to potential 
participants - but the boundary between those interested 
in a sale and those interested in advice is often hard to 
determine. There cu:e also advisory centres at regional 
level, or run by professional or industrial eissociations 
or by government institutions. Written “check lists" and 
introductions to provide information to customers for 
training are supplementary to the work of the advisory 
centres. C±oss -boundary information centres have come 
into being - Icurgely through major public training 
institutions (GR: QAED, IR: FAS, DE: Federal Institute 
for Labour E: JNESf, P: lEFP) , but in some Ccises at the 
initiative of industrial eissociations and chambers - in 
the form of continuing training databases vdiich cd.low a 
multi -provider comparison of baaic data on continuing 
training services. Quality evaluations, however, cure 
rarely included in the databases because of problems with 
definition and legal difficulties. 



The private Spanish service provider DIRFO (EG) can be regarded as a special 
case, providing Its custconers (enterprises and private Individuals) not only with 
a market survey of available training services but also with appropriate quality 
assessments . 

"Since Its Initial conception In 1989, DIRFO has offered two services: 

The Information Service: Its purpose Is to provide custcomers with full 
to-date Information on the training and human resources consxiltlng programmes 
and services available on the Spanish market. This Information Is regularly 
tr ansm itted through publications and Information media, \dien responding to 
consTiltatlons about all types of programne, courses, facilities, etc. 

* The Quality Service: Its purpose Is to consxilt customers provide fcham with 
valid references on the quality of the training service mentioned. 

During the description of the DIRFO model, the Initial training quality system 
and Its evolution Into the present system, oriented towards quality effect- 
iveness of training, \ylll be presented" [E] . 



In seme cases, the provision of advice and information to 
customers is also cuiversely affected by the absence of 



the necessary base, in the fom of a general "lack of 
valid and reliable statistics" [GR] about continuing 
vocational training. 



The Gezinan caae stud^ lists the following exaxoples for the i n p r o ve ment of the 
transparency of continuing vocational trainixig: "i^>art from the home stud^ 
sector, there is no consumer protection bod^ available to the continuing training 
consigner, becaxise conventional consumer protection institutions are not generally 
concerned with the quality of continuing vocational training. One exception is 
STIFTUNG WARENTEST, initiated and sponsored by the government, vdiich currently 
\jndertakes a quality stud^ of the services offered by continuing training provi- 
ders on behalf of the Federal Ministry for Education, Science, Research and 
Technology (SffiWFT) . Smaller studies undertaken by Stiftung Warentest are alreacfy 
available on the quality of EDP courses. 

"The ’quality check list on continuing vocational training* , presented by the 
Federal Institute for Vocational Training (BIBB) in 1992, can also be regarded as 
an additional government activity in the interests of consumer protection. The 
quality criteria laid down in the check list have been acc^ted into many quality 
standards \diich, for example, have been formulated by various independent 
training providers." 

[Explanatory note: The BIBB was founded in 1970 on the basis of the German 
Vocational Training Act. The object of the BIBB is to develop the bases for basic 
and continuing training in all vocational sectors and to modernize and Improve 
vocational training. The BIBB is also active in the fields of advising arrangers 
of home study courses and providing information to the public.] [D.] 



3. 2. 2. 3 Self-manitoring the training providers 

Some case studies refer to concepts of self-monitoring of 
quality by training providers or in-house training 
departments. "Self-manitoring" in this context can be 
understood as meaning that training institutions ccopile 
and publish quality statutes on a voluntary basis and 
measure their activities against them. In order to ensure 
and demonstrate greater independence of the quality 
yeurdsticks, they are in many cases sponsored not by the 
individual training institutions as such but by regional 
or sectoral associations of training providers or enter- 
prises. Verification of ccmpliance with the quality 
statutes is, accordingly, the responsibility either of 
the individual training institution or of the association 
of training providers. In individual cases, industry 
associations or technical advisory councils take over 
this role . 
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Quality seals are often awarded as external confirmation 
that the self-irposed standards are being ccaiplied with. 
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An exanple o£ self-^monltoring by training providers is given in the Gexman case 
study: 

The association "Pinaiterhildung Hamburg e.V. " is a regional o£ training providers 
vAio undertaJce to meet certain quality criteria and award a quality seal to 
certi£y that this has been done. The association currently conprises 130 
continuing training £acilities, representing about two* thirds o£ the capacity o£ 
the publicly accessible continuing vocational training in the Haznburg region. 

CoBzpliance with quality standards developed within the association is a pre* 
requisite £or membership. These standards relate to the personnel and equipment 
provided £or the courses# participant*related quality £eatures (such as the 
transpeurency o£ the service o££ered# the availability o£ training consultancy arid 
the contractual arrangements £or the participants) # and special criteria £or 
training measures relating to £inal qpiali£ications . The eissociation uses a 
questionnaire to verity that its members are conplying with the quality standard. 
A committee o£ assessors can verity that the standards are actually being 
observed. 

The quality seal awarded by the association since 1 January 1994 seems# on the 
evidence so tar# to be an isportant criterion tor both private customers 
enterprises in selecting training providers. 

The British initiative "Investors in People" can be regarded as a conc^t 
relating to selt *monl toring in internal continuing training; "^le Investors in 
People National Standard is a key initiative to encourage employers to invest 
ettectively in the skills needed tor business success. The standard developed by 
business tor business and s\pported by the JJR Government is promoted nationally 
by Investors in People UK# a business led body. . . . Participation in Investors in 
People is voluntary. To be awarded the Investors in People Standard an employer 
must: 

make a public comnitment tram the top o£ the organization to develop all 
enployees to achieve the organization's business objectives; 

regularly review the training and development needs o£ all employees: 

take action to train and develop employees# udien they are recruited and 
throughout their employment; and 

* evaluate the Investment in training and development to assess achievement and 
improve tuture ettectiveness . 

The systems that employers need to have in place to demonstrate to an independent 
qualitied assessor that they meet the criteria o£ the Investor in People Standard 
are tor them to determine . The award is not made on a permanent basis. Every 
three years a company moist undergo reassessment to ascertain whether it has 
maintained sutticiently high standards. 

By end o£ August 1994 there were over 1000 organizations in Britain recognized as 
an Investor in People# employing over 500# 000 people. At the same time over 9# 700 
employers were tormally camnitted to achieving this standard. . . . 

A key element in the Investor in People Standard is the measurement o£ the 
ettectiveness o£ investment in training. Research has shown that employers 

^dio are recognized as an Investor in People use many ditterent ways to measure 
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the effectiveness and quality of training. Ihe most rigorous methods involve a 
formal evaluation system, idiich may include individual elements such as formal 
feedback on the quality of training; tests of knowledge and pre- and post- 
training performance measurement and/or the attainment by an individual of a 
qualification or recognized ccanpany standard" [UK] . 

The British case study views the "Industrial Training Organizations" as a 
sectoral approach to quality assurance on the training provider's responsibility: 
"A network of over 120 ezxployer led. Industry Training Organizations (ITOs) \ih±ch 
cover industrial sectors employing around 85% of the workforce. ITOs monitor 
future skill requirements and training needs in their sector, develop and promote 
occi^tlonal standards and encourage ezxployers in their sectors to increase their 
training efforts'* [UK] . 

Another, Jrish organization concerned with questions of quality in continuing 
training is the JITO: "The Irish Institute of Training and Development is a 
voluntary xneznbership body that sees its mission as the provider of growth for 
those Involved in training and development and by so doing, to become the Irish 
voice for the development of people both at organizational and individual level 
in Ireland. . . . The Institute has 1120 members currently of >diich 115 are student 
members. The institute provides: a professional body for cons\iltants and trainers 
in Ireland, it aims to develop and monitor professional standards for tra inin g, 
to provide regional and national fora for discussion and policy making in the 
human resource development area, and to set standards for professional conduct 
for the profession" [IRL] . 



nils form of quality assurance, using stcuidcurds and 
quality seals irposed by the training providers them- 
selves, is by no means such a convenient solution for the 
providers as might at first be thought. After all, the 
public presentation of quality standards with a contract- 
ual effect does create a transparency vAiich provides 
clients and participants in the continuing training vdth 
the possibility of evaluating continuing training serv- 
ices in advance and verifying them afterwards. Hbwever, 
such self-irposed standards generally fsd.1 to have a 
binding effect on all providers; th^ thus fail to 
inprove the ccanparability of continxiing training pro- 
viders as far as their customers axe concerned. In 
addition, apart from fundamentcLL declarations of intent, 
they generally lay down quality criteria which are more 
external because they are designed to be easy to verify. 
In addition, quality catalogues, quality seals, etc., cue 
difficult to operationalize and so often fail to conform 
to the objects of the particular mecisiures. Their market 
acceptance will be low \dxen they serve as a mere 
marketing instrument in the ccnpetition between the 
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providers of continuing training. 



Hie category of "self -monitoring" among training pro- 
viders can also be said to include quality prizes, for 
vdiich enterprises and training providers can compete if 
their continuing training meets certain quality criteria 
vdiich are regarded as exemplary. Hiese quality prizes are 
awarded in a number of states by government departments, 
industry associations or quality certification bodies. 



Quality prizes xnentioned in the case studies Include the following: 

C7nited Kingdom: "In February 1994 the Quality Award, based on the European 
Quality Model, was launched by the British Quality Foundation with the s\Q>port of 
GovemzDent. All conpanies applying for the X^K Quality Award will need to show how 
the training the developDpent of employees is undertaken and Implemented. 
Campanies will also need to demonstrate how the effectiveness of tra in i n g is 
measured" [UK] . 

In Ireland a National Training Award is awarded: "The National Trai n i n g Awards 
2 ire designed to encourage training excellence and to demraistrate the link between 
training ixxves^nent i m p r oved business performance. Each FAS [the Training a n d 
Eoployment Authority] region selects a training award winner from its grant 
applications . ... The national award winners are selected from the regional 
winners by an independent jury representing the social partners. This coaxpetition 
promotes training and best practice in industry across the regions and in all 
size of conpanies" [IRL] . 



3 . 2 . 2 . 4 Quality assurance as a result of certification of 
recognized trial qualifications 

According to all the case studies, training providers and 
in-house training depcurtments in the nine Member States 
participating in the project are free to plan and uiple- 
ment training measiures vdiich offer no recognized final 
qualifications - in other words without reference to 
formal vocational qualifications under the basic voca- 
tional training system or to qualifications recognized by 
governments or by professional and industrial associ- 
ations . Hie flexibility of the continuing training market 
- the variety of the services it offers and its ability 
to react rapidly to changing requirements - is based on 




that freedom and represents an important quality feature 
of the available continuing training. In fact, the 
majority of continuing vocational training in many Member 
States is certified, if at all, merely by certificates 
awcLTded by the providers themselves. 

On the other hand many employed people can be seen to 
have an interest in seeing successfvil qualifications 
certified on a multi -enterprise basis in order to sustain 
or improve their attractiveness in the job market. 

In so far as continuing training institutions provide 
preparation for recognized vocational qualifications, or 
themselves provide training and certification based on 
such qualifications, it is possible to talk about 
indirect quality control, the index being the success of 
the pcurticipants in passing the tests. The quality 
requirements cissociated with external test standards 
primarily take effect in the resvilt of training measures 
when the participants are examined. In seme cases, how- 
ever, they also relate to the prepeuration for tests 
provided by courses (for example through regulations 
governing certain numbers of hours worked, practicals, 
the qualifications of the continuing training personnel 
or existing qualifications among the participants) . 



'' In this connection, "certification" means confirm- 
ation that recognized final vocational tests have 
been successfvilly passed and not application of the 
EN ISO certification to training institutions, \diich 
was discussed earlier. 
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In fche Dili ted Kingdom, an increasing number o£ further training providers and 
in-house training departments are referring to a descriptive standardization of 
vocational qualifications, NVQs (England and Wales) and SVQs (Scotland) . They 
r^resent . . . 

"a national framework of qualifications to meet the needs of Industry and to 
allow the individual to obtain qualifications based on nationally acc^ted 
standards of coopetence which are set by enployers. In England and Wales, the 
framework is cooplled by National Council for Vocational Qualifications ^dilch 
accredits the National Vocational Qualifications. In Scotland this task Is the 
responsibility of SCORVEC which accredits Scottish Vocational Qualifications. . . . 

National Vocational Qualifications (NVQs) are based on occipatlonal standards of 
coaxpetence. The coaxpetencles required in eoployment are defined by Iiead Bodies. 
Lead Bodies cooprlse r^resentatlves of eaployment Interest (e&ployers and 
enployees) , education and training providers and relevant professional groups. 
Some ITOs also fulfil this Lead Body role. . . . 

Occipatlonal standards describe the level of s)d.ll and knowledge required to be 
able to perform a job effectively at work. Lead Bodies work with nationally 
recognized Awarding Bodies In the design of proposed BVQs. All proposed quali- 
fications are th«n submitted to the National Council for Vocational Qualifi- 
cations (NCVQ) for accreditation of award. Accreditation may be granted for a 
TnavtTTnmi of five years after ^dilch re -accreditation must be sought again. . . . 

NCVQ also xaanitors the quality of the qualifications by laying dam criteria 
which Awarding Bodies must meet. Also through monitoring of contracts agreed with 
the Awarding Body for each accredited Qualification" [UK] . 

With regard to qualifications In continuing vocational tra in i n g In Germany "as In 
basic vocational training and In other parts of the training system (such as 
schools universities) there are again sectors which are regulated and 
standardized by the state". Two sub-sectors can be distinguished: "On the one 
Vtaru^ there are training courses and qualifications gained under the academic 
continuing training system on the basis of Land laws; this refers especially to 
technical colleges, post -secondary technical colleges, universities and 
academies . The technical colleges are of central import an ce here . On the other 
Vian^ there are further training arrangements covered by the Vocational Tr ainin g 
Act (BBIG) and the Crafts Order (HwO) . This non-academic continuing vocational 
training Is carried out by firms and outside training providers” [D] . 



3. 2. 2. 5 Quality assurance as a result of contractual 
regulations and specifications 

In documenting quality assurance measures, a nuniber of 
case studies also with questions of the Contractu al 
relationship between the participant or client and the 
provider of the continuing training. Hie basic concept Is 
that the contractual arrangements should make It possible 
to adapt continuing training services to special or 
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changing needs, and that certain quality featxures in 
continuing training should be made binding by contract. 

In seme states, collective agreements (such as those 
between enployers and eaployees) ed.so include regulations 
governing in-house continuing training, vdiich also touch 
upon quality matters in the broadest sense. 



In the Articles of Association of "Welterblldung Hamburg e.V.”, certain regula* 
tions are laid down for contracts with participants, covering for exanple rights 
of withdrawal, procedures for giving notice, payment arrangements, data protec- 
tion and evidence of participation [D2] . 

At VDAB, Belgium, there are precise regulations as to the binding elements \diich 
an offer of a continuing training progr a mne must include. 

"An offer of any training programne should contain at least following elements: 

1. Name of the programne, as a general description of the content. 

2. Objective: in terms of vdiat one can do after training. 

3. Content divided in units. 

4 . Duration 

5. Organization (full days, half-time, all days of the week, weekend, evening) 

6. Conditions of entry (\diat is necessary: basic knowledge or experience, %diat 
course can be followed as preparation) 

7. Outcome: function, eqppllcatlon in the job 

8. Possible follow through to oth^ training courses 

9. Related programnes 

10 . Location 

11. Cost 

12. How to attend 

The contract for a training course can be made in different steps and in several 
ways: 

The company reacts on the offer and places an offer, the training institute 
confirms by a tender, that is to be confirmed by th^ company 
The training institute makes a tender and the customer confirms. 

The contract between individuals and the training institute is "M>d«> 
enrolment and acceptance by the training institute. 

The students sent by a conpany make a new contract by accepting the training 
plan presented by the trainer” [BF6] . 

In many cases of cooperation between firms and training providers in France, 
specifications as to the quality of the service became an integral part of 
contract. In the case described, Renault France prepared a specification for 
external buying-in of continuing training, in vdiich the requirement for and 
verification of the quality of the provider's continuing training service is 
codified. 

Such specifications are also an integral part of contract in Luxembourg 
cases of Prolingua and CFFC. In many other cases of internal quality assurance in 
continuing trai n i n g, the formulation of strict quality requirements for 
buying-in of external training measures is a by-product of th e firm' s own 
activities . 
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3. 2. 2. 6 Quality assurance as a result of multi -provider 
standards 

Standardization of those elements of continuing training 
\diich are not siibject to the influence of individual 
training institutions or clients is treated in all the 
case studies as an essential means for determi n i n g 
criteria and ens\u:ing the reproducibility of quality 
ass\u:ance meas\u:es in continuing vocational training. 

Various forms of such standardizations are mentioned in 
the case studies: 

- Quality standards in continuing training \diich relate 
to particular sectors 

- Quality standards \diich are derived freon fixed voca- 
tional profiles and/or test systems [cf. Section 
3.2.2] . 



- National or European standardizations of quality in 
vocational training 

* National or European standardizations on the setting-vp 
of quality management systems [cf . Chapter E] . 

Among others, the Greek case study refers to the problem- 
atical relationship between fixed standards and the 
s ui tability of the continuing training service to meet 
thft customer ' s needs : "An actual unfeasibility in estab- 
lishing universal quality standards and generally applic- 
able quality assurance procedures that may to be f\mc- 
tional and effective in any type and form of training 
activity. On the one hand training quality standards and 
assurance procedures have to be uniform and independent 
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fzxsn any specific training agency, type, form, content or 
setting (national standards or generally acknowledged 
standards like ISO 9000} and on the other hand they have 
to be applicable and adaptable to each one individual 
structure and activity of the respective training 
agencies, types, forms, contents and settings (training 
institutions or ccapanies, on-the-job or off -the- job 
training, public or private funded training) " [GR] . 

In the scanetimes heated controversy regarding general 
quality standards in continuing training, it is appeirent 
that standardizations cure entirely linked to particular 
interests s not only is their content derived from speci- 
fic views of quality criteria \diich are to be applied, 
but their irplementation affects the economic interests 
of individuals, providers and firms . 
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Hxus, the Gezxaan case study reports In detail on the controversy regarding 
CERTQUA as a certifying organization for training providers under EN ISO 9000: 
"The criticism of CERTQUA Is directed at the question of the Independence of the 
cooDpany/ v^ch Is regarded In many quarters as a problem. From the rmi on side, 
the criticism Is made that, through GERTQfUA, the DIHI [the German Industrial and 
Trade Association, an organization of the Chambers of Industry and Comnerce In 
Germany; author's note], \inconcemed by public debate and xinrestrlcted by any 
control”. Is trying to establish Itself ”ln key areas as a quasi -governmental 
substitute body” . (...) Doubts are being expressed about the Independence of 
CERTQUA becaiise the founding members themselves allegedly operated as providers 
of continuing vocational training. The criticism expressed by the professional 
association of private providers of vocational training follows the same lines 
(...).” The case study comnents on this as follows : ”The debate as to the 
independence of GERTQUA, or lack of It, disregards the point of view that this 
form of certification says nothing about the content of the services offered by 
the providers of training but merely confirms that quality management Is In oper- 
ation. It may be possible to solve the problem of Independence If certification 
bodies are established by other groups In society or If CERTOUA opens Itself up 
to other groups. As private enterprise institutions, certification bodies slb such 
cannot lay any claim to a monopoly; pluralism of suppliers of certification 
already exists today; with the flood of ISO certifications In the training 
sector, other suppliers - some of them already established In the industry - may 
offer themselves as providers of certification services for training providers.” 

The French study reports: "From 1990, Initiatives by the profession are going to 
multiply as a response to the new demands of enterprises and public authorities. 
The concern was, for the profession, to monitor the suppliers and to provide 
verifiable undertakings udilch would make It possible to clarify the relations 
between the enterprises and the training bodies. These Initiatives relate to: 

The adoption of the international standards of ISO 9000: about ten training 
bodies, either Independent or attached to major production enterprises, have 
been certified. 



The drafting of national standards by A£TK)R: work was undertaken on defining 
standards relating. In a first stage, to tezxninology, and to supply and demand 
In training, and In a second stage to service and the provision of training 
services. These standards are Initially esperlmental and, \dien approved, 
became obligatory In the concluuslon of public contracts. 

The creation of. a professional office for qualifying training bodies. The 
principle Is to grant a certificate to bodies vdilch confirms ability to 
provide particular services (In accordance with a xiomenclature of types of 
services) , In view of Its personnel, the durability of Its structure and Its 
customer references” [F] . 



Quality standards do not irpose constraints on the 
flexibility and creativity of training providers \dien 
they are based on a framework \diich is independent of the 
providers of continuing training but allows scope for 
individual action by the various providers and are 
ijipleinented on their own responsibility. Quality ass\ir- 
ance by reference to multi -provider and provider- 
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independent standards, based on independent activities by 
the providers of continuing training, offers the advant- 
age of an arrangement vdiich can cdmost be objectivized 
but is not affected by state or private interests. Such 
standards improve the transparency of the continuing 
training market, provided that their criteria are pub- 
lished and compliance with them is monitored. They do 
however eJ.so result in provider selection. Smaller 
specicd.ized training providers are often overstretched by 
the costs and requirements for certification to genereQ 
standards, [cf . Section 3.3.2] . 



In Ireland, a standardization organization with voluntary mexnbershlp, the Irish 
Quality Association, is presented as an exaxople: "The Irish Quality Association 
is a membership organization; membership entitles members to an initial audit 
based on a coopleted questionnaire; if the q[uestionnaire indicates a sufficient 
level of quality the IQA Approval Board will appoint an Inspector to carry out an 
audit. The inspector will report the IQA .^jproval Board vtbo will decide to award 
or not to award the Quality Hark" [IRL] • 

The French case of CESI-ltonaandie describes the attempt by a private tr ain i n g 
provider to introduce quality assurance systems based on certification u n d er 
EH ISO 9000. CESI is in a cooplete minority in France in this respect. Apart from 
the high costs associated with the introduction of appropriate quality manage- 
ment, there were problems with translating the abstract standard into continuing 
training practice. The company expects this campaign to produce positive market- 
ing effects in addition to internal rationalization. 

In the case of CSiETA - Eat Eaaonne, the state training provider takes the French 
AETOR standard as a guide for its quality assurance activities, without aiming at 
certification. This certification is not required by the customers and is too 
costly for the training provider. 



3. 2. 2. 7 Quality assurance in continuing training as a 
result of State conditions for assistance 

A sxjbstantial peurt of continuing vocational training in 
cUl states reported on by the Ccise studies receives 
assistance from goveinmnent or loccU authority funds or is 
provided directly by government or local authority 
providers. Public cissistance is provided not only for the 
continuing training of the unemployed, for purposes of 
vocational integration, or the qualification of specicCLly 



disadvantaged persons, but also some sectors of in-house 
continuing training. There can be a variety of reasons 
for in-house continuing training to be co- financed from 
European or national budget headings, such as ... 

- i m p r o v ing the level of qualifications of the workforce, 
to the general benefit of the econony 

- siipporting the introduction of new technologies 

- assisting regional development, especially in rural and 
underdeveloped regions 

■ promoting the vocational activity of women and the 
vocational integration of young people 

■ assisting the integration of special groi:ps of people 
into working life, such as the handicapped and the 
socially discuivantaged. 

Public assistance for in-house continuing training is 
regularly linked to the observance of conditions for 
assistance. It is appcurent from some case studies that 
these conditions increasingly not only involve formal 
criteria but also take into account the quality of the 
continuing training measures. 

Becatise of the large scale of the public assistance 
provided to continuing vocational training in many 
countries, it results in the authorities having an 
important control function in respect of the quality of 
services provided in the continuing training mcurket. In 
some cases the public clients or sponsors take over 
existing national quality standards, vAiile in others they 
draft their own lists of quality criteria in accordance 
with their pcurticular objectives. 



For exaz^ple, the British Goverzxment has since September 1995 been assisting 
training facilities and enterprises \diich take on young people for training^ 
under the prograxtme entitled "Accelerated Modem Apprenticeships”, It is a 
condition for receiving assistance that certain quality criteria should be 
observed. 

"The UK Government, along with key partners, has taken every step to ensure that 
frameworks currently under design are based on a checklist of quality standards. 
Funding will not be available from Government for those frameworks \diich do not 
meet the criteria. 

The common core criteria include such elements as: 

Training - Content and outcomes, the vocational sector will set the framework, 
waking clear the skills, knowledge and understanding the apprentice is to 
develop. It is esqpected that training will take place, yfhere possible, on 
enployers' premises. 

Assessment - apprentices will be expected to gain at least NVQ level three. 

Review - ongoing review and evaluation of apprentice progress is an essential 
part of the programme. 

Trainees - Rights and Expectations, the training plan will be underpinned by a 
written pledge or agreement between the enployer and the young person and 
underwritten by the TEC \diich demonstrates the ccnmltanent of all partners to 
training" [UK}. 

In Germany, continuing vocational training of the unemployed is regulated by the 
Employment Promotion Act [AFG] . Continuing training measures are contracted by 
the Federal Institute from si;ppliers in the continuing training market. Condi - 
tions attached to the provision of assistance to fiurther training and retraining 
programmes, which also affect matters of the quality of the measures, also apply: 
"The starting point for defining the quality criteria of measures is § 33 AFG. 
The Federal Institute for Labour defines the 'type, scope, commencement and 
ijxplementation of the measure after a due assessment of the circumstances, 
particular account being taken of ... the content and structure of the vocational 
training meaisure ...". ... In the case of the independent measures, the Federal 
Institute for Labour may, pursuant to § 34 AFG, refuse to provide assistance to 
the participant if the type and structure of the measure fail to conply with its 
quality requirements; in the case of contracted measures, (quality yardsticlcs can 
also be prescribed in the contract with the contractor. . . . The most important 
quality criterion in evaluating vocational training measures, as far as the 
Federal Institute for Labour or for the Employment Exchanges is coxicemed, is the 
effect on labour market policy. . . . The quality criteria relating to training 
meaisures contain statements on: the objectives and designation of the course, 
future areas of vocational activity, target/addressee group, access requirements/ 
necessary previous knowledge, instruction periods (in theory and in multi - 
enterprise/in-house practice), teaching means, technical equipment available to 
the course, ninxiber of teaching personnel, qualifications (training and pro- 
fessional experience in adult education and vocational training) of the teaching 
personnel (trainers and lecturers), checlcs on learning and success, social 
instruction given to the participants (qualification of the personnel concerned) , 
knowledge and skills after coopletion of the measure, course subdivision, 
framework teaching plan [Dl] . 
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INSi In Spain is developing detailed recognition procedures for training pro- 
viders with \diich it collaborates as a government institute, and also for home 
study courses: 

"As regards quality assurance in training, we have selected the system of approv- 
ing evaluating the centres, programoes and means for home study covirses. This 
is a conplex system, developed two years ago in order to inprove quality levels 
within hornfi study Instruction. The process takes place in several stages: 

• the establishment of quality standards. 

• the approval of participating centres. 

• planning. 

The principles on \diich the system is based and the procedures adopted are as 
follows : 

adaptation to different types of user. 

permanent support in puq>ll/tutor, puq>il/system and puq>ll/puq>il interactions, 
the flexibility of the Instructional material, 
quality as an organizational concept." 

Only those training providers who successfully pass the IMEM recognition pro- 
cedures participate in the public continuing training programnes . 

In Greece, the "Vocational Educational and Training Organization" (QEEEC) was set 
lip two years ago. This organization has developed a minimum catalogue of quality 
requirements for assisted training measures: "The Organization has adopted and 
applies a set of ™^n^ln^lln quantity and quality standards and requirements pertain- 
ing to material and training structures of the vocational tra inin g institutes 
... it prescribed the trainers ' required qualifications and competencies and 
it Haa explicitly set up a scale of awarded training certifications and the 
corresponding prerequisites and acquiring procedures" [GR] . 



3. 2. 2. 8 Quality assurance in continuing training as a 
result of governmental regulation of the continu- 
ing tredning market 

Exanples of direct governmental regulation of the quality 
of vocational or in-house continuing training hy means of 
laws and decrees cure documented only in isolated cases 
(such as in the German case stud^ with the "Hbane Stuc^ 
Protection Act" [D4] ) . States increasingly adopt a 
s\:ibsidiary role: they confirm their intervention in the 
continuing training market to cureas in vdiich the market 
itself does not guarantee the st^jply (i.e., in particu- 
leu:, the sector of training problem groiq>s in the labour 
market, consumer protection, etc.) . 
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The influence exerted by the state on the quality of 
continxiing training tends more often to take the form of 
the indirect effects of other action in the field of 
educational, social and economic policy. Factors vdiich 
help to determine the quality of continuing training are: 

* State or public recognition of certifications and 
associated quality requirements to be met by previous 
training measures [cf. Section 3.2.2.41 

* Requirements for the provision of state assistance to 
continuing training [cf. Section 3.2.2.71 

* Governmental training facilities \diose effects ed.so set 
quality yardsticks for the surrounding independent 
continuing tredning market 



Hxus the Greek case study reports on the Msmpcwer &nployxDent OSzrgraniratios [QAED] : 
"The existing continuing vocational training network is characterized by a 
strilcing diversity and a remarkable extent of the si^pliers simply. ... A 
substantial portion however of the continuing vocational training activities is 
being offered by public or state controlled agencies having a rich tradition and 
a remarkable reputation in the vocational training and this fact does not allow 
any reliable assessment of the influences that the quality criteria and the 
standards have on the demand for continuing vocational training by indlvid- 
\ials and the coopanies" [GRl] . 



statutory requirements inposed on firms \diich require 
a peurticular scope and/or pcurticular contents in bcisic 
and in-house continuing training 



Statutory regulations and recpiirements elsevdiere (such 
as those relating to accident prevention, environmental 
protection, product safety, etc.), \diich give rise to 
requirements in respect of the quality of the in-house 
continuing training 

The statutory consumer protection regulations in the 
continuing training sector 
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In Gezmany the Home Study Protection Act (Fern USG) is typical of such regula- 
tioios: "Home stud/ occvpies a special position within continuing training in the 
Federal Republic/ from quality aspects/ because the home study services are 
reviewed and licensed by government on the basis of quality standards. . . . Uhder 
the Home Study Protection Act of 1976/ all home study courses offered for 
valxiable consideration - exc^t those designed entirely for leisxire and enter- 
tainment purposes - require a licence, ^application also to be made for a 
licence for important changes to courses already licensed. . . . The decision 
%diether to license a home study course is a xnatter for the 'Central Government 
Office for Home Study (ZFQ) ' . In the course of the licensing procedure/ both the 
technical and the instructional quality of the teaching material are reviewed in 
the light of the objective of the course/ as is the advertising and the form and 
content of the home study contract to be concluded between the course participant 
and the home study institute." The German study assumes that the objective of 
consimoer protection is achieved by the statutory regulation - but it also assumes 
that it acts as an obstacle to innovative developments in home study in Germany: 
"In that [the Fern USG] has prescribed the structures vdiich existed vdien it was 
first passed/ it has greatly coiostricted the scope for adopting new creative 
approaches axid taking risks in the - development and implementation of courses. 
Home study thus appears to be a static/ sometdiat non- innovative area of training" 
[D4] . 



The settixig-i;^ of public institutions and authorities 
to assure the quality of basic and continuing voca- 
tional training 



Greece: "In this context an active State intervention is taJcing place today. A 
recently ratified Law on Regulations of Btaployment and Other Relevant Matters 
(Law 2224/1994) laid the foundation of a National Certification Centre of 
Continuing Vocational Training Structures under the auspices of the Ministry of 
Labour. The main intended duty of this Centre is the development of standards and 
the establishment of relevant procedures for the certification of the continuing 
vocational training providers' structures and for the quality assurance of their 
offers as well as the training and certification of trainers" [GR] . 

in Spain/ as a state authority vdiich is also a training provider/ is taking 
on the task of developing and implementing quality standards through the licens- 
ing of associated training providers. 



state aid to field trials, research and projects 
connected with questions of quality in continuing 
vocational training. 
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For exazi^le. In the Gexxaan case stud^: "An in^rtant izmovative function In 
quality assurance in cont inuin g vocational training is perfozned by the model 
experiments vdiich have been conducted for 20 years and are assisted by the BIBB 
[Federal Institute for Vocational Training^ Berlin; author's note] . A solution to 
a problem or an innovation in cont inuin g vocational training is tried out in the 
real world of vocational training through znodel experiments . * The course of the 
model e3q>eriment is scientifically monitored and evaluated. Ihe intention is to 
achieve a rapid and wide-ranging further development of vocational training and 
continuing vocational training. In particular, model experiments are used to 
develop and test innovative solutions to both future and current problems . ... 
Observation of quality assurance in continuing vocational training also takes 
place through research projects awarded by the BIBB or BMBW [now the BMBWFT, 
Federal Ministry for Education, Science, Research and Technology; author's note]" 
P] . 

In France, various forms of research auid documentation work take place under 
state control yfhlch are intended to serve ais a baisis for inprovlng quality in 
continuing training; 

"As a regulatory body, the State, which has been said not to have intended to lay 
rules restricting access to the training market, initially endeavoured to inprove 
the transparency of that market by providing operators with statistical and 
qualitative information on the main features of the market. Thus, over the laist 
ten years, on the initiative of the Vocational Training Delegation (Ministry of 
Laboir , Ssployment auid Vocational Training) , an lnportant research study hais been 
developed with a view to obtaining a better under s tend i ng of the "training 
market": statistical analysis of data relating to the activities of training 
bodies (from 1984) , setting-up of stud^ prograsmes dealing with the quality of 
training (1989) auid changes to the training apparatus (1990) , the launch of an 
in-depth survey of 400 bodies (1993) auid the isplementatlon of a prospective 
stud^ of the sector of private training bodies, decided upon with the representa- 
tive professional organization (1994) " [F] . 



Administratively binding quality yardsticks often have a 
rather lu^roductive standardizing effect. Their criteria 
are generally external, in the interests of ease of 
practical administration and verification. In many cases, 
therefore, there are fears that quality assxurance could 
jeopardise flexibility and speed of reaction, and hence 
also quality elements in the continuing training system, 
as a result of axbitrcury interference frcsn above with 
ccxitinuing in-house and vocational training. On the other 
hand, the sxjmmcuries of scane case studies make the point 
that the binding nature of governmental regulations is 
not achieved by quality assxirance systems instituted 
training providers and firms on their own responsibility. 
In many of the Meoiber States, this point is the s\]bject 
of controversy at present in training policy. 
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Greece provides an example: "... an Inherent contradiction In the movement £or 
quality assurance In training, though not a matter exclusive to Greece, that Is 
one that has arisen from any relevant debate and proposed action. On the one 
hand, the establishment o£ quality standards and quality control and assurance 
systems for training that have been developed on a legal basis Is gexierally 
acc^ted as necessary and Is being supported, and on the other hand, at the same 
time, the development application by the training providers of Internal 
T nonhani ama Ijiprovlng assurlng the quality of their training offers on a 
market-oriented basis are felt desirable and are being promoted". 

The Gercaan case study refers to the same debate and makes the following recom- 
mendation In the matter of govenxment Intervention: "Because of the wide variety 
of the continuing vocational training system, however, the solution cannot be a 
standardized quality assurance system. Ensxuring the quality of continuing 
vocational training calls for a wide range of approaches with different functions 
and enphases. General framework conditions for the development of uniform quality 
standards can be Imposed via appropriate state regulations. In addition, however, 
adeq[uate scope must be left for the Individual development of quality standards 
by the training providers" [D] . 



3 . 3 Changes in the continuing training market cis a 
result of quality assurance 

1116 increasing demands made by custcmers and public aid 
institutions on quality assxurance in vocational and in- 
house continuing training have repercussions on the 
continuing treuLning market. In ed .1 the case studies, it 
becoones clear that the contours of the training landscape 
will be lastingly changed by the quality debate. 



Two aspects need to be distinguished: 

* First, in the internal scene of in-house training 
depcurtments and in the case of training providers, it 
is foreseeable that the work will beccme professional- 
ized, Continuing training services are provided in a 
fo rmal ized, controlled process, no longer on an 
Tinp l anned and unstructxured basis. This in tium places 
new demands on the vocational coopetencies of the 
proteigonists in the continuing training process. 




- Secondly, relations between the demand and supply sides 
in continuing training are changing. As a result of 
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quality assurance methods, interfaces are shifting and 
new forms of cooperation are occurring. 



3.3.1 Professionalizatian of continuing vocational 
training 

Efforts to introduce quality cissxirance into vocational 
and in-house continuing training are made at a wide 
variety of levels: educational, business management and 
administrative quality criteria rank side by side. They 
are taken into account with the use of a great many 
widely differing methods of evaluation, and converted 
into quality imp r ovements in continuing training by means 
of a great many instruments. One way in \diich this 
heterogeneity becomes apparent is in the wide variations 
in the selection and weighting of the exanple cases in 
the national case studies. 

However, all these heterogeneous methods and instruments 
of quality assurance have one thing in coaxmon: they 

result in professionalization of continuing training in 
and for firms . A new structure of the continuing training 
sector is being created not only by the special mode of 
action of in dividual instruments, such as those relating 
to the documentation, standcurdization and organization of 
continuing training, but simply by the thought given to 
quality matters vdiich is associated with all the instru- 
ments . 

This restructuring relates to a number of elements: 

* Increasing transparency in vocational and in-house 
continuing training. 

* Intensification of cooperation between contin\iing 
training institutions and their environment, meaning in 
particular their participants and clients, and finally: 



- The assistance given to internal continuing training in 
the case of training providers and in-house training 
depeurtments - extending to the point of developing 
independent vocational profiles and formalized careers 
in the continuing vocational training sector. 

Hitherto, the openness of the continuing training market 
has also involved a low level of formalization of the 
education of those active in continuing training: the 
lectiurers, the seminar leaders and the training managers. 
In all states reported on by the case stxidies, the routes 
of access for the continuing training personnel are 
considerably less regulated than those of their counter- 
peurts in the general academic education system. Accord- 
ingly, a multicoloured range of qualifications and pro- 
fessional experience is often found in the continuing 
training personnel - providing a basis not only for 
flexibility and creativity in this sector but also for 
regulcu: quality problems. In the course of the greater 
efforts being made to intzxxluce quality assiurance 
measiures into continuing training, changes can be 
e3q>ected in the qualifications of the continxiing training 
personnel; formalization, standardization and the greater 
need for knowledge about the organizational overhead, all 
factors \diich are involved in quality assiurance methods, 
may result in the strengthening of professional profiles 
in the continuing tredning sector and so, ultimately, in 
the long-term establishment of quality assurance in 
continuing training via professional qualifications. 



In the Ihiited Kingdom, efforts are being svade to professioxialize the vocational 
training sector by incorporating typical qualifications for the continuing 
training personnel into the NVQ system: **Within the National Vocational Qualifi- 
cation frame^rk standards have been established ^dxich are specific to functions 
of training and development, and line management. By defining the criteria for 
appropriate trainer competencies, the standards siqjport the TJK Government's 
strategy to ensure increased quality in training provision" [GK] . 

In Ireland, FAS has developed a system of qualification requirements for 
lecturers: "FAS operates a trainer approval system for contracted training and so 
screens the qualifications and resources of the private contracted trainers 
against the profile of training required by FAS regions. Unapproved trainers may 
not quote for training course provision outside their approval status. Trainer 
£q>proval includes the listing of the following: directors and principles of the 
providers, names of any associated companies, track record, training eocperience 
and qualifications, types of courses and the regions in focus, resources avail- 
able to the trainer, written references. ... Formal training of trainers in 
Ireland is increasing in demand and availability through Universities, Regional 
Technical Colleges, The Dublin Institute of Technology, The Irish Memagement 
Institute, and the HID [Irish Institute of Training and Development] . " [IRL] 

As far as France is concerned, Joel Bonany considers that the quality assurance 
movement in continuing training is having effects on the "professioxialization" of 
the continuing trainers : 

"One of the high stakes in the coxistitution of the training market is in the form 
of the identification of those active in it. It is sigxiif leant that gxrovps of 
training bodies are today giving thought to the axialysis and s t rengthenixig of 
their collective identity. These ideas echo the development of qualification and 
certification, ^diich axre becomixig established as tools of legibility. 

With the development of these institutions, we are seeing a move away from a 
logic which centred professioxial legitimation on individuals towards a system in 
\diich structures are becoming the basis for profess ioxialism and for coxifidence in 
contractor/client relations. 

The knowledge and skills committed to this qualification, then, are not so much 
those of individuals (relative to the content of the training) as procedural 
kxiowledge defined on enterprise scale (quality manual, specification, etc.) and 
collectivity (ISO or AFNOR staxidards) . 

This tendexicy is becomixig general today, and it can be said that the vocatioxial 
traixiixig sector has been able to Import logics of ratioxialization and profession- 
alization vhich were taking effect in other sectors. However, this extension to 
trainixig has not yet been fully effective: the thfane of quality is relaunching 
old arguments on new bases, and the question arises of quality approaches 
suitable for the specific needs of training" [F] . 
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3.3.2 Chaziges in the market relaticns between those 
sullying and demanding training 

Quality assxnrance in continuing training is understood, 
in all the case stiadies, as being primarily a strengthen- 
ing of the custcmer orientation of training institutions. 
T *hi H view initially involves disregarding vdiat specific 
requirements are associated with it, and vdiether the 
cases relate to external training providers or in-house 
training departments vAiich "market" their products 
internally: in all cases, the phases prior to the actual 
training measure, the provision of advice and information 
to participants, the analysis of training needs euid the 
marketing of training beccme particularly important. 

T *hi g has repercussions on the planning of the trai n i n g 
institutions' product ranges: first and foremost, they 
have to expand their advisory services. An advisory 
service has to cover not just needs analysis and planning 
of continuing training measures, but also final 
evaluation services vAiich can form the starting point for 
a new identification of needs. This involves the training 
provider in a new distribution of tasks among his 
employees: they have to take on functions as "training 
consultants", "training maxiagers" or "training moder- 
ators"; the straightforward teaching and lecturing 
activities will increasingly be able to be supplied by 
external experts as well. Training institutions are thus 
following the route taken by the seminar organizers, 
towards a market-oriented service centre. Specifically, 
Hift question arises of \diat services a training provider 
hag to develop in order to comprehend and act \:pon his 
custcsners' quality requirements. In the case of the 
training provider, product orientation has to be second- 
ary to custcmer and process orientation. 
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This effect of Internal quality assurance In continuing training on the training 
market is described in the case of the large enterprise Renault Portugal: 

"The enterprise resorts to the provision of services \Anea it cannot meet the 
needs identified. It is at this level that the link-\qp with the training maurket 
takes place. To this end, the enterprise prepares a specification ^diich details, 
in particular, the objects of the service required, the content in very general 
terms, the deadlines, the site of the training, the characteristics of the 
participants and Is inviting the sxqppllers to present their proposal. 

Having consxilted the market and received the proposals, the enterprise starts the 
analysis process. This is undertaken by multidisciplinary teams Mdio select the 
most suitable proposal and open negotiations. 

It must be enphasized that the specification Itself contains a brief description 
of the criteria for assessing the proposal. These are than brought to th e 
knowledge of the sxippllers. 

This approach by the enterprise generally results in the sxqipllers adopting 
quality procedures. Consequently, its end effect is to Inprove the functioning of 
the training maurket" [PI] . 

^e French case of the small enterprise CELJT-Arance shows that quality manage- 
ment in SMEs can also produce ccoparable effects on the market, forcing external 
training providers to rethink: 

"A more personalized trainer/custaaer relationship i In general terms, and for tha 
enterprise in particular, the practice of Isuying from a catalogue is tending to 
die out. Service providers are showing greater willingness to listen to the 
specific needs of enterprises, and are making appropriate proposals. On hho 
client's side, this trend is expressed by the drafting of more precise specifica- 
tions. The enterprise is in better control of analysing its needs and tries to 
formalize the methods of training it expects. But the discussion with tha service 
provider is essential in order to clarify/correct the definition of needs. The 
enterprise attaches importance to this dialogue and expects its contractors to 
show an ability to rethink suid reexamine. It rejects out of hand those service 
providers \dio make an offer without prior analysis . . . 

Specification and quali ty: the importance attached to the dialogue with the 

trainers in the specification definition phase extends to the implementation 
phase, ^e enterprise does not limiit its conception of quality to miere ccaxpllance 
with the specification, vhich necessarily leaves grey areas vdien nooHg have not 
been made explicit, and sometimies proves inadequate (if the trainees' needs 
learning capacity have been wrongly assessed, etc . ) . Thus the enterprise expects 
its trainer to be able to listen, provide follow-tip ahd ad£q>t during training. 
The enterprise tries to reconcile obtaining conpetltlve proposals from trainers 
with a desire to maintain permanent relations, in order to exploit th<» knowledge 
of the enterprise vhich the trainers have been able to acquire, ^ho capacity 
for dialogue ^diich that gives them." 



In the documented cases, it must not be ovez'looked that 
the burden of quality control is increasingly passing 
frcan the custom e rs to the sv^spliers of continuing train- 
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Ing. The awakenixig of quality awareness among custcmers 
for continuing training Is associated with a need for the 
training institutions to be able credibly to verify the 
quality of their offers ex ante. This is not merely a 
question of training marketing. Training providers 
insted.! \diole quality management systems, \diich have 
replaced extensive quality checks by the custconer enter- 
prises and departments. Control of the custcmers is thus 
becoming more methodical: it now only verifies \diether 
the training s\:pplier's quality assurance is functional, 
rather than reviewing each individual training measure. 
This has effects on the s\:^liers' market. 

- Certifications to recognized standards, especially 
EN ISO 9000, are becoming a nwaH-iiTm of ccmpetition among 
the training institutions . They relieve the customer of 
the need to carry out his own special checks on the 
training institution's quality management, and to some 
extent create transparency in quality assurance in 
continuing training \diich affects the market. At the 
same time, there is an apparent risk that standards may 
be conplied with at the lowest possible level if they 
cure to be used merely to gain custom. EN ISO 9000, in 
peurticuleur, allows considerable scope for this. 

- Formalized quality assurance methods and certifications 
entail high coats. If these costs cure rolled on to the 
training s\:ppliers, they result in a new selection of 
training providers: smaller providers and those in the 
social sector will find it more difficult to bear such 
burdens. This can give rise to the risk of narrowing 
the continuing training market and protecting larger 
suppliers from the effects of conpetition. 

- 'Hie problem of quality assurance of individualized 
training services seems essential. Oontinuing traini n g 
is becoming less capable of standardization; it is 
differentiated by content and forms of instruction 
across the in-house division of labour. This calls for 
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a high planning and evalxiaticsn effort, \diich has to be 
s\:^lied again for each new meas\u:e. i^ropriate offers 
can be made to the firms, cis customers, vdien they have 
a Icurge number of identical jobs with similar learning 
requirements. This means that, as a rule, only large 
enterprises will be likely to ccannission such continuing 
training and evalxxation services. Smaller and medium- 
sized enterprises will, at best, only be able to call 
i:^>on the necessary demand potential for the planning of 
tailor-made continuing training conc^ts evaluated for 
their fecial needs in the context of multi -enterprise 
sectoral continuing training associations, with all the 
special problems these create. This problem has been 
dealt with in detail in [Chapter 2] . 

On the basis of this difficulty/ the small French enterprise Raymood Geoffray 
derives its desire for greater market transparency/ through government initi- 
atives if necessary: 

”IzrpllcatloDS for the client/trainer relationship outlook - ... change in 
relations with trainers: Initially/ the enterprise looked for no more a 

single guideline in the formulation of its needs / then it looked in the cata- 
logues for a product vdiich could do the job. 

This phase is over now, and the enterprise hayi become more demanding. It no 
longer wishes to choose from pre-existing offers/ but asks that an offer be 
created sis a function of its needs . It asks the service provider to make a 
proposal/ then corrects that proposal as a function of its needs. This Hayi 
sometimes forced trainers to adapt and train themselves to supply vdiat is 
required. 

What is more/ mastery of the demand for training extends to the training process 
itself. When it seems that the service is tending/drifting towards less interest- 
ing content/ the enterprise endeavours to reorient the training. ThiS/ of course 
assumes that the enterprise is monitoring the course of the service/ vdiich is not 
always the case, but does arise vhen the training takes place over a long period 
and/or on its own premises . . . 

Danger of developing loyalty to a trainer: The natural tendency/ \dien a trainer 
has given satisfaction/ is to work with him again. The risk/ however/ is that he 
may not be conpetent in the subject-matter of xxew requirement, ^le enterprise 
has already experienced disappointments of this kind , , , 

Lack of identification of the offer and the relevance of the institutional 
approach: It is necessary for the state to ti<fy up the market. It must have a 
register of the service providers and the disciplines in vi hlgh they are compe- 
tent. 
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The draft of an OPQF Is very relevant in this respect. Hbfwever, It Is not 
sufficient, and it is still necessary for the enterprise to ask its service 
providers to demonstrate training courses ^diich it has already carried out 
(similar to that required) , together with client references, so that the enter- 
prise can telephone them if necessary to obtain their point of view. 

Certification would also be a very important symbol of quality. A priori, if only 
one of two training enterprises was certified, the enterprise would favour it. 

Finally, enterprise is aware of the existence of the AFMOR standards but has 
not read them in depth, considering this to be a sxjbstantial labour" [F3] . 



- In contrast to a good many other external service pro- 
viders, an enterprise discloses internal work organiza- 
tion and personnel management methods to training 
institutions \diich are to evaluate continuing training 
measures. This may possibly touch \:pon sensitive areas, 
\diich can adversely affect the necessary intensity of 
cooperation. 

- The in-house partner cooperating with training pro- 
viders is generally a continuing training, personnel 
cuivancement or personnel department, and is only 
exc^tionally the department for \diich the training 
services cure being provided. Precisely in the evalu- 
ation of continuing training measures, however, direct 
contact with the participants in the continuing train- 
ing and their siq)ervisors in the planning and evalu- 
ation {diase seems essential . Links would therefore have 
to be created at new levels, \diich would also affect 
internal allocations of functions. 

In g umma Ty j. it can be said that although ccnpetition in 
the continuing training market does promote the striving 
for quality, it makes it difficult to separate si:ppliers 
and customers for quality assurance. The very close 
cooperation among those involved vdiich is regul ar ly 
necessary for quality assurance in continuing training 
r-an be ispaired hy differences cuid conflicts of interest 
amrmg the market participants . The further develop m e n t 
will show vdiat methods of cooperative quality assurance, 
conforming to market needs cuid at the same time effec- 
tive, may develop. 



4 Quality assurance and l a pro v ing the quality of 
continuing vocational training 

Reading through the case descriptions from the Member 
States, and this summarizing report, may possibly prcanpt 
the critical reader to ask vdiere among all the descrip- 
tions of in-house training management, training needs 
analyses, tailor-made continuing training, evaluation, 
etc., the actual quality assurance services are to be 
found. Ultimately, all the concepts, methods and instru- 
ments described are nothing new. We have beccnne familiar 
with them before imder a wide variety of headings. There 
cure long passages, then, in which the cases also read 
like attempts on the part of the entezprises or training 
providers to improve their activities in continuing 
training. 

This state of affedrs is not particularly siurprising. 
Measiures to assiure the quality of a product, a process or 
of a whole organization prove themselves to be necessary 
in that they take up the existing objectives and review 
the effectiveness of the processes, or try to improve it, 
against that background. 

Quality assiu^nce has little to add to those continuing 
training processes which have hitheirto enjoyed optimum 
success in achieving their objectives. All that is needed 
here is an appropriate undertaking by those involved to 
pursue their labours consistently in the futiure. But 
\dierever continuing training has failed to meet its set 
targets, has met them only at the cost of unacceptable 
expense, or proves unreliable in achieving them, quality 
assiurance will also result in substantied changes in the 
continuing training process. At the outset, the quality 
assiurance approach in continuing training means only 
this: the invariable claim made 1:^ in-house continuing 
training to be target-oriented and efficient is taken 
seriously, reviewed criticcdly at all levels of planning 
and implementation, and supported by prcBxpt corrective 
action. This means that vhat is really new about this 
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approach is the atteirpt to Integrate formative evaluation 
into the continuing training practice. 

For all those involved in continuing training, however, 
the inputs and costs always involved in instituting 
quality assurance only seem justified \dien the result is 
to achieve not just new rules and standards but a genuine 
isprovement in the quality of continuing vocational 
training. 



4.1 Quality in continuing training 

Before anything can be said about isproving the quality 
of continuing training, it is first necessary to clcurify 
escactly \diat is meant 1:^ the (good) quality of continuing 
vocational training. 

As mentioned above, the question of quality always has to 
be answered in relation to objectives. There is no such 
thing as "the" good continuing training, separate from 
its specific purpose, any more than there is such a thing 
as "the" good advisory service, means of transport or 
production machinery. 



4.1.1 Objectives of in-house continuing training 

Wherever mention is made of "the" good continuing tredji- 
ing, a continuing training objective is necesseurily 
tacitly assumed. 

It is very much an essential fimction of quality assur- 
ance in continuing training that it must, first and 
foremost, account to the managers, employees, lecturers, 
etc. involved for the objectives they ax& pursuing 
through continuing training. 

It is no matter of chance, therefore, that, in the cases 
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£rcan Member States, the detezmixiation o£ the objectives 
of continuing training and processes of hazmonizing those 
objectives with corporate strategies constantly recur as 
essential quality assurance points [cf . Chapter 1] . This 
is how the objectives of continuing training first beccane 
transpcurent and known in many firms . This illustrates the 
hybrid nature of continuing training just as clearly as 
possible wrong objectives, and inccmpatibilities and 
conflicts between objectives. However painful this 
realization may be for the missionary teacher, learning 
is not an end in itself but msdces sense only \diere it 
benefits identifiable objects of individuals or organiz- 
ations. 

The exanple cases also mcdce it clear that these objec- 
tives of continuing training are extremely heterogeneous . 

Although the terms of reference of the study were already 
quite specific (continuing vocational training in/and for 
firms) , the cases disclose a leurge number of corporate 
objectives, various hybrid forms of objectives and also 
some objectives of states and individuals. The specific 
orientation of this stu<^ towards in-house continuing 
training brings business objectives into sharp focus. 
Nevertheless, many of the documented cases also enphasize 
the interests and objectives of the enployees and peurtic- 
ipants involved in continuing training: 

* adaptation of euployees' technical skills to job 
requirements 

* iitproving cross-disciplinary euployees' skills (key 
ccBipetencies, etc.) in order to msdce them more flexible 
and motivated 

* ioproving the firm's cconpetitiveness by giving it more 
productive and quality- conscious enployees 

* creating an enthusiastic and creative enployee poten- 
tial as the basis for an innovative and flexible firm. 
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Quality assiirance in continuing training is intended to 

help ensure these objectives are achieved systematically/ 

focal points being . . . 

* accurately targeted orientation and irplementation of 
continuing training/ 

* setting or disproving continiiing training management/ 
in-house or in the case of the tredning provider/ 

* maVi ng continuing training more econcmical or reducing 
its cost/ 

- disproving cooperation vrLth esctemal trai n i n g providers/ 

* maifing the act of teaching in continuing training more 
effective/ 

* 1-aV-ing the eoployees ' interests into account. 



In the case of Renault Portugal, for example, it le pointed out that the 
enployees associate increased job satisfaction with the skills they have 
acquired, that they consider their prospects of career adva n ce m e n t to have been 
safeguarded as a result, and that they generally feel that continuing tra in i n g 
has Inproved their quality of life. These objectives, idiich enployees associate 
with continuing training, are also found in many other cases [PI] . 



As a rxils/ the participation mechanisms are illxistrated 
via \«hich eoployees and peur^icipants in continuing 
training can bring into the process of in-house 
ri cunh-imi-ing training their expectations of continuing 
training cuid their career objectives. 

Because of the predoaninant corporate philoso^diy of 
greater involvement and integration of all employees/ 
especially into quality assxirance processes/ thoughts on 
employee peur^icipation and specific methods of ensuring 
that participation play a major part in virtually all 
r!agftg [cf. for example LI and lA, cuid also PI/ UK3/ F3/ 
BFl/ IBL3] . 
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At this point, however, it should be noted that these 
peurticipation mechanisms are still methods of business 
training management, \diich aim to enstire, so far as 
possible, accurately targeted, efficient and accepted 
continuing training measures for the firm's objectives by 
involving the enployees. 

lliese objectives certainly include the eaiployees' inter- 
ests to a large extent (enployees cQso have an interest 
in the ccsxpetitiveness of their fim eis the bcusis of 
their job) , but they certainly do not have to be identi- 
cal with the subjective aims of the individual ecployee. 
These possible conflicts of aims are hardly documented in 
the cases, although this may have adverse conseguences 
for the firm. Seme cases of government tr aining providers 
or consximer protection projects in continuing training 
are at least aware of this aspect of the learner as the 
subject of his objectives [cf . inter alia D5 (Hcane Stxidy 
Protection Act) , D4 (Stifttmg Warentest) , GR5 (INE/GSSE) 
etc . ] . 

Although quality assxirance in continuing training abso- 
lutely requires the identification of the objectives of 
continuing training for its activity, it becomes apparent 
cQso from the documented cases that the aim« of continu- 
ing training can themselves be reflected and refoxmulated 
by systematic quality assvurance. The way in 'tdiich this 
happens is that in many cases the foxmulation of cl ea r 
continuing training objectives by the firm's management 
is made necesssury for the first time by the introduction 
of quality assxirance procedures in continuing training. 
In this way, the scope of possible continuing training 
options becomes apparent to those responsible in a 
completely new way, and new continuing training objec- 
tives are often defined accordingly. 

On the other hand, the documented involvement of all 
enployees as active participants in the planning, imple- 
mentation and evaluation of continuing training, tdiich is 
documented in many cases, has the effect that new pros- 
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pects and interests Influence the objectives of in-house 
continuing training. Quality ass\u:ance in continuing 
treUJiing can thus help to change the objectives of 
continuing training sionply by its permanent ccmnpulsion to 
reflect i^>Gn all stages of continuing training. 



4.1.2 Quality assturance in teaching and learning 

Against the background of a given objective/ quality 
assiurance in continuing training is intended to make all 
hhoi training processes more effective and efficient, ^lis 
relates especially to the actual teaching act of instruc- 
tion and learning, including its preparation and follow- 

Hie (quality of the operation of teaching and learning is 
characterized by the suitability of the rnecuis used and 
their rational d^lo>yment. 

All the familiar questions of vocational teaching arise 
here again cuid need to be answered against the respective 
background situation: 

■ Is the content being taught suitable for the learning 
objectives? 

■ Are the teaching methods appropriate to the learning 
objectives and the pi^iils? 

* Is the le arning location or cconbixiation of locations 
appropriate? 

■ Do the lecturers' methods conform to the learning 
objective? 

* Are non-personal learning media being used in a way 
\diich is appropriate for the learning objectives and 
the participants? 
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Neither these questions nor others regarding the effect- 
iveness and efficiency- of the act of teaching are new. 
The innovative element of quality assurance resides in 
the fact that these questions are no longer discussed hy 
scientific experts; they are raised in the course of the 
practical process of continuing training, and have to be 
answered every day. The practical need for a solution and 
the real ccanpulsion to rationalization to vdiich in-house 
continuing training is subject result in continuous 
efforts to make it more effective, to try out inproved 
solutions constantly, etc . 

Even in this process, conflicting interests are entirely 
possible. At this point it is less a conflict of objec- 
tives regarding the value of the continuing training than 
a conflict between the firm's interest in making tredjiing 
more effective and the traditional academic solutions 
favoured by the continuing training personnel within the 
firm or working for external providers. 



4.2 What do quality cissurance methods contribute to the 
inprovement of continuing training? 

Quality assurance in continuing training is initially 
nothing more than a method of training management, 
vdiereby continuing training processes and organizations 
are to be permanently optimized in accordance with the 
respecti-ve objectives. 

As is always the case with the use of management methods, 
vhat matters is that the method should be applied in a 
way vdiich is appropriate to the objective and situation. 
If this is forgotten, the danger exists that quality 
assurance procedures will solidify into bureaucracy, and 
vdiat will be achieved will be the opposite of what is 
intended. 

The documentation of the cases from the Member States 
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makes it clear that forms of quality assurance exist 
there \diich still have their problems on the side of the 
systematization and precision of measurement/ just as 
sometimes the real i i cp r o v ements of continuing training 
remain obscure. This again confirms that quality assur- 
ance in continuing training is a developing area. 



4.2.1 Quality assxjrance as the realization of a formal 
regulatory system for training management 

As stated earlier/ quality assurance in continuing 
training initied.ly lies solely in the attempt to study 
existing objectives/ procedures/ measures/ methods and 
products in continuing training to determine their 
coonpatibility and efficiency/ and harmonize them accord- 
ingly. 

No vocational training or didactic idea/ or any idea 
\diich is new in terms of educational psychology/ is 
genuinely induced into the continuing training scene via 
quality assurance. No new concept relating to the innova- 
tive organization of lecuning or of new roles for the 
instructors is iioparted. 

^le quality cissurance specicd.ist is not necessarily a 
specicd.ist in continuing training. Ccnpletely divorced 
from specific continuing training measures/ contents and 
methods/ quality assiurance endeavours to find procedures 
\diich formally convey a planning and implementation of 
continuing training \diich is sxii table for objectives and 
effective at all levels of the process. 

This aspect of formalization through quality assurance 
becomes pcu:t:icularly clecu: in corresponding national or 
inteiniational standards on quality assiurance in continu- 
ing training. 

In a nunber of cases/ the reference of training providers 
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or firms to these "quality standards in continuing 
training" takes effect, i:p to the point of certification 
of training departments or training providers as organiz- 
ations \diich operate and are structvired in accordance 
with standard series EN'ISO 9000 or national standards 
[cf. Digression on EN ISO 9000 and Ch^ter 3] . 

NatuTcLLly, this in itself will not guarantee any improve- 
ment of continiiing training, for example in the sense of 
vocational teaching or in the sociopoliticed. sense of the 
"White Paper on Growth, Oonpetition and EoDployment" . 

At any rate, quality assvurcuice, simply as a formal system 
of rxiles on the management of continuing training pro- 
cesses within the firm, achieves the integration of 
continuing training events into the centre of the firm's 
develqpDoent . Included in this are strategic reflections 
by the management on continuing training objects, 
together with considerations relating to efficiency 
i m p r o v ements and financing. Quality assiUTcUice in continu- 
ing training ensmres that this kind of managesnent pre- 
occi:pation with tredning matters is not sporeulic and 
random but systematic and continuous. Continuing voca- 
tional training abandons its marginal position in 
the firm in favour of becoaning an econcmdc factor in the 
firm's success. 

In all the documented cases of firms from the national 
studies, this phenomenon becoanes clear. 



For example, Paxil Jung says in writing of the Luxembourg caLses of ARBBD and 
Du fbnt: "In the two caises described, the needs to be met derive from a trans- 
lation of the enterprises' operational, and strategic objectives into action plans 
\diich require clearly defined qualifications and thus generate an approach 
vdiereby the existing qualifications are aul^ted to the target qualifications 
through individuad.ized training plans . In the two enterprises selected, the 
approach aulppted coaxprlses a precise definition of the objects to be achieved by 
means of the training, the elaboration of continuous control dtiring the IxEplemen- 
tatlon of the meaumre, and, a posteriori, an evaluation of the results achieved. 
In both caises, training is cleaurly defined ais an Investment and those responsible 
for training act aa training consultants” [L] • 



Conversely, this formalizaticn of continuing training 



manageanent involves the danger that continuing training 
within the firm will beccene bureaucratized, that adminis- 
trative regulations will cramp creativity, and that the 
focal point of attention will be monetary calculability 
and short-term quantification. 

These risks are e3q>ressed in the expert's judgements and 
cd.so in a number of exanple cases in the studies. 



Joel Bonanv notes critically, in the Arench study, that quality assurance has 
made a major contribution to the rationalization of the formal relationship 
between sellers and purchasers of continuing training, but little contribution to 
ijiproving teaching: 

"Efforts relating to thA planning of training have, hitherto, been limited to 
mastering the act of teaching itself (the only atteopts relate to the most 
predictable and reproducible types of training, such as tra in i n g in lamguages and 
computer systems) . A first problematical aspect that the quality approache can do 
little to take into account is that of involving the trainee himself in the 
quality approach and the mastery of the act of teaching. It seems, in fact, that 
the quality spproach been focused, hitherto, on the relation between the 
client enterprise and tha training body but fails to apprehend the 
trainer/trainee relationship vdiich, however, is vdiere the essence of quality 
resides. aspect remains a "black box", tidilch is currently p r onpting those 
involved to wonder how to handle it" [F] . 



In seme lcu:ge European enterprises \diich, in connection 
with their certification under EtT ISO 9000, have also 
often subjected their continuing training depeurtments to 
t-hft analogous standards, the suspicion appears justified 
that, by way of a vastly ixuzreased system of forms cOid an 
overvdielming compulsion to documentation, contintiing 
training can actually be administered "to death". This 
danger becomes peurticularly apparent vhere quality 
assurance is applied to continuing training for SMEs. As 
already stated in Chapter 2, these enterprises need 
anything but a comprehensive formal set of rules to 
systemize their continuing training. Simple recom- 
mendations to assist direct communication among all those 
involved on continuing training matters, including an 
evaluation of the successes of continuing trai n i n g and 
information on the qucd.ity of exteznal training pro- 
viders, are certainly more helpful to these firms than 
the introduction of additional administrative systems. 



er|c 



169 



On the other hand/ it is logical that the desired inter- 
nal treatment of continuing training as an investment in 
the growth of the fim should bring with it the appropri- 
ate business management processes. 

Quality assurance in continuing training therefore 
inplies precise costing and the legitimate effort to 
achieve the most cost-effective alternative in the form 
of continuing training [cf. the Spanish cases E2: 
H7I-TENEQ/ E4 and E5] . It should not be overlooked/ 
however/ that quality assurance is not only controlling/ 
and merely inproving the economics of the continuing 
training may fail to achieve its objectives. The reason 
this risk is particularly great is that the offsetting in 
cash terms of the benefit of continuing training cannot 
succeed satisfactorily/ in the nature of things/ so that/ 
in continuing training events/ special attention in the 
course of rationalization is paid to the costs as the 
only really quantifiable parameter. 

For the same reason/ aiixiliary constructions to quantify 
the successes of continuing training (for exanple reduc- 
tion of absenteeism rates / conpany suggestion scheme) 
should also be characterized as such. They are not 
central indicators of the benefits of continuing 
training. 

Additions to eoployees ' skills result in increased 
productivity in the working process/ dnproved production 
quality/ greater flexibility and ability to react of the 
working systems - and they thus play a peurt in deciding 
the competitiveness and economic success of the firm. 
This has long been known to the e3q>erts - but precise 
quantification of this contribution made by continuing 
training to the economic success of the firm is imposs- 
ible in operational practice. For this reason use has to 
be made of aiixiliary constructions and clear indicators/ 
in order to permit at least qualitatively sound success 
appraisals for quality assrurance methods. 



Itie present weakness of the evalxiation of continuing 
training in evezyday business practice contributes to a 
risk that quality assurance in continuing training is 
\jnilater6J.ly perceived as a way of Inproving ecancmics. 
Where quality assurance is perceived as mere bureaucra- 
tization by means of sets of rules and mere improving of 
economics by means of costing, there really is a deuiger 
that learning and teaching will be deprived of their 
innovative and creative power. 

In this case there would be justified fears that teaching 
anH lecuming processes would become routine and cconnon- 
place, and would eventvially be suitable for rationaliz- 
ation at will, like other working processes within the 
firm. However, these fears, vdiich are also mentioned in 
scone cases. 



The French study mentions this in connection with the influence of quality 
assurance continuing training on the role of the t e ac her s and trainers • 

"The cultural change ^dilch is taking place may affect the Incentives b ehin d their 
action motivation. The qpiality approaches must therefore handl e the tension 
between: 

a logic of trivial! ration (a codified contrivance, trai n i n g is a department 
like any other) , 

the constraint specific to training, ^nAiere management of risks and 
unexpected situations involves retaining degrees of adaptability, ability to 
react through dialogue and, more broadly, capacity for innovation" [F] . 



also have a different background in the more traditional- 
istic notions of seme teachers or teaching associations. 
In fact, the claim of quality cissxirance systems in 
continuing training also lies in the critical scrutiny of 
the instructional act of teaching and learning itself. 

Although this is a specific case in \diich the weakness of 
evalviation mentioned above is still particularly notice- 
able, quality assurance endeavours to assemble the 
optimum learning materied., teaching methods, media and 
teachers for the given learning objectives. As a result, 
natxirally, the involved lecturer finds the veil removed 
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frcan the "n^steries" of his successes or failures. But 
such an ending to "guru statiis" in continuing training 
certainly does not iniply that the teaching/leeuming 
process becomes conmonplace, or that the role of the 
teacher loses its cooplexity - on the contrary. The 
systematic reflection of all teaching euid lecuming 
processes in continuing training/ with a view to their 
irprovement, is of benefit to both teachers and learxiers. 
However, the suitable evalxiation methods for this cure 
still lacking. 

If the risks of qucQity cissurance in continuing training 
for the enterprise Ccises go by the names of bureau- 
cratization and unthinking efforts at economy, the 
trcdning providers eure exposed to other dangers. 

As was stated in C!hapter 3, external training providers - 
because of the requirements of firms and government 
authorities but eJ.so becaiise of the requirements of 
individual customers for continuing training - cure 
increasingly coming under pressure to siibject their own 
procedures to quality assurance or to have their organiz- 
ation certified under national standards or EH ISO 9000. 

In all Member States, certification institutions alrecufy 
exist - or are in the process of being set - for 
confirming quality management by training providers. As 
regarxSs improved market transparency and consumer protec- 
tion for SMEs and individuals, this flood of certifi- 
cations of training providers is, of course, welcome. In 
a number of documented Ccises from the nationcLL stxidies, 
it becomes apparent that such attenpts to gain a qucLLity 
certificate can modernize training providers' working 
processes and their vAiole organization, and result in 
products being offered vhich are suitable for the market 
[cf. for exanple F5 CESI -Normandie, or for a case of a 
certification institution D3, CERTQUA] . 

On the other hand, it is ijipossible to overlook the fact 
that for many training providers quality certification is 
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primarily a marketing instrinnent. This creates a danger, 
in the fact that quality certification \inder ENT ISO 9000, 
for example, is often confused with evidence of good 
quality teaching axrrangements, vdiereas in fact the 
certificate certifies nothing exc^t the existence of 
quality management within the organization. Naturally, 
this can and should also mean that the vocational train- 
ing services offered are better, but the certificate does 
not guarantee this. 



The controversial discussion regarding certification of training providers raises 
a few questions for Pedro Cordova in Spanish study: 

"The practice of quality certification of training institutions has not became 
established in Spain as it has in the other countries. More than that, the possi- 
bility is contenplated with extreme reluctance, especially by the actual 
establishments concerned. Is the reason a more convenient situation for profes- 
sional activity? Is it accpetable to expect the customary laws of the market to 
clarify available training, to classify institutions in terms of their 
quality efficiency? Is there not too much risk, during this period, of seeing 
wasting of resources and frustration of expectations, and the degradation of the 
image of training? Is not this a serious diluted irresponsibility, given that, in 
view of the cooaplexity and difficulty of mastering the aspects of measurement or 
verification schemes vdiich relate to human resources within the organization, 
there haa been neglect of the use of systematic approach methods \diich would make 
it possible to obtain sufficient information to validate and decide upon the 
effectiveness or relevance of the processes or the options?" [E] . 



4.2.2 Quality assurance as an opportxmity for improved 
continuing vocational training 

Most of the cases from the national studies are, in the 
strict sense, certainly not documents for implementing 
quality assurance in continuing training - at least not 
if the formal ISO requirements are taken as a basis. What 
is regularly documented, instead, is how a more system- 
atized form of training management (or elements of one) 
result in a generally improved result of continuing 
training in or for a firm. The procedure followed by this 
training management is demonstrated, together with the 
way in \diich it acts to improve continuing training 
measures, continuing training services, the cost struc- 



tijre of contixxuing tredning, etc. Finally, the beneficied. 
effects on the lecurning process itself, the enployees' 
skills and the consequent benefit for the firm are 
indicated. The Spanish stiidy, in particular, refers to 
the need for defining qu^ity assiurance in continuing 
training in order to ens\u:e that CGannunicaticn takes the 
correct form. 

i^>art from the fact of the inprecise concept of quality 
ass\irance in continuing training, the cases thus charac- 
terized refer to real inprovements in in-house continuing 
training, extending through to the instructional act of 
teaching and learning, \diich has certainly been stimu- 
lated by the attempt to introduce systematic continuing 
training management (in quality assxurance) . 

Thus, although the previous section referred to possible 
dangers curising from a misunderstanding of quality 
ass\irance in continuing training, pointing out that 
quality ass\irance means the management of continuing 
training and not necessarily improvements in teaching or 
the achievement of sociopolitically desirable objectives, 
nevertheless the available cases and the expert's judge- 
ments leave no room for doubt that such an imp r o v ement in 
continuing training can be achieved by quality assurance. 



Joel Boxianv# too, establishes this innovative possibility of quality assurance In 
continuing training: 



”lhe current extension of c[uallty approaches Is having an Irportant structuring 
effect. It Is, In fact, an Innovation In ways of managing training In market 
organization. Its effects are leading both to a rationalization of the economics 
of training (attempt to control costs and processes, better definition of needs 
and greater suitability of offers) and professionalization (restructuring of t he 
market based on a concern for transparency) " [F] . 



In fact the quality assvurance approach in continuing 
training offers many opportunities, through its consist- 
ent application vdthin the firm or by the training 
provider, to intrxxiuce i m pro v ements into continuing 
vocational training practice. 



Mention has already been made earlier of the necessary 



reflection on objectives of continuing training, ^^lereby, 
first, continuing training is demonstrated to the manage- 
inent to be a strategic business factor, and secondly the 
external training providers ina]ce customers' requirements 
the objective of their quality c^surance. 

Equally committing is the formation of indicators to 
achieve objectives at all levels of the continuing 
training process, \diich ina]ces the development and status 
of that process trcuisparent at all times to all those 
involved. 

It is only cis a result of this that the evaluation of 
events in continuing training tcdces on its true dimen- 
sion, and also its permanent incentive. 

Evaluation as a constant reflective and self -reflective 
process of all those involved in continuing training is, 
first, undoubtedly a requirement \diich arises from the 
quality assurance approach. In addition, however, this 
process is also the driving force behind productive 
change and i m p rt- n Ti eaTiftn t-- in Continuing vocational training. 
The hinge between quality assurance in continuing train- 
ing and the desired qualitative improvements in 
continuing trcdning and especially the instructional act 
of teaching and learning is thus the joint process of 
continuous reflection by all those involved in continuing 
training. Quality standards and management systems merely 
provide the occeision for this process, and ensure that 
t-Vift necessary reflection criteria are available in the 
form of continuing training objectives and success 
criteria. 

Tflie creativity of the employees, mcuiagers, lecturers, 
etc. provides the content for this permanent process of 
reflection - t-Tnin giving rise to innovation and improved 
quality in continuing training. 

By this indirect route, quality eissurance in continuing 
h-ra-ining actually beccBses a driving force at all levels 
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of the continxiing training process for innovations and 
inprovements . This is edso the focus of documented cases 
in the national studies, in \«hich such inprovements to 
the elements of the continuing training process are 
described: 

* analyses of training needs 

* learning organization 

* didactics and teaching methods 

* new roles for teachers and pipils 

* lecuming contents 

* combination of learning locations 

* use of media. 

Quality assxirance in continuing training is described as 
having beneficial effects on these and other factors in 
the continuing training process. 

Even more importcoit than these effects, however, is a 
tendency which is apparent in ed.1 the national studies 
euid which is gaining ground in the firms as a result of 
quality assurance in continuing training: this is the 
growing recd.ization that quality assurance can only be 
achieved if all employees are fully izxvolved. Quality 
assurance in the continuing training sector, as else- 
vdiere, can only produce its effects in terms of process 
optimization and innovation if it changes from a manage- 
ment method into a "bottom-ip" movement by the workforce 
[cf. for exanple PI, IKL3, GR3, BFl, F3, LI, L2, L4, 
UK3] . 

The hinge function, referred to eeurlier, of continuous 
joint reflection on ways of achieving i npro v ements in 
continuing training, which is idiat makes quality assur- 



ance a factor in corporate innovation in the first place, 
necessarily builds on opportunities for self-determina- 
tion and independent responsibility within the firm. 
InclTided in this is a receptiveness on- the peurt of the 
corporate culture for greater participation and shared 
re^xsnsibility for all eonployees. 

In relation to the quality assiorance process itself, more 
and more elements of self-assessment, self -monitoring and 
automatic i np -rov amen t-- will replace external control 
T paffhani amg and top-down instructions. 



In the Luxembourg case of Du Pont, for exanple, the firm is actually going to the 
point of increasingly revoking quality management standards in order to give the 
employees more ind^endent respo n s ib ility [L4] . 

It is becoming apparent that quality assurance here must 
become an ascending spiral : the enployees can only 

perform these increased tasks of process optimization, 
extending into continuing training, on the basis of 
appropriate skills (continuing training) - and this leads 
on to new possibilities, etc. 

Enterprises, however, are not training institutions, nor 
are they institutes for developing the personalities of 
their employees. It is therefore necessary to rememiber 
that the processes that have been described for enabling 
eaployees to optimize processes in continuing training 
are needed in couple tely identical form to optimize 
processes in the firm's actiial production activities. 

Against the present background of market growth and 
technological development, promising forms of enterprise 
and work organization for Europecui firms are those in 
\diich an irportant role is assigned to the develop m ent of 
their eaployees' planning skills. 
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5. Quality Assurance dm Continuing Vocational Training: 

Summary and Outlook 

It is clear from the views of the European experts who were involved in the national case 
studies and from the cases themselves how much importance is attached to applying 
quality assurance systems and related measures to continuing vocational training. 

With the quantitative expansion in the continuing training sector and the strategic 
importance of continuing training for the economic and social development of the 
Member States, the quality issue has become an urgent one. Quality assurance procedures 
are used to reflect continuously and systematically on training needs, results and 
effectiveness, leading to an ever higher standard of continuing training in Arms and 
among training providers. Such procedures have a lasting effect on the continuing training 
scene. 

This synthesis report on the current state of affairs in nine Member States is based on 47 
case studies from the nine countries and on the views of experts who conducted studies 
on the situation of quality assurance in continuing training in their respective countries. 

Chapters 1 to 4 present an analytical appraisal of the national experts' work, along with 
a "digression" on the use of ISO EN 9000 in continuing training, by reference to the 
following aspects: 

• continuing training, quality management and quality assurance in Arms; 

• quality assurance in terms of cooperation between Arms and external training 
providers; 

• quality assurance and structuring of the continuing training market; 

• quality assurance and ways of improving the quality of continuing vocational 
training. 

The next section but one deals with the problems and outlook for quality assurance in 
continuing training, but flrst of all, and as a service to the busy reader, let us take a look 
at the most important flndings from chapters 1 to 4. 

5.1 Summary of the current state of qirality assirrance in continiring training in Eirrope 

5.1.1 Summary: Quality assurance and quality management in firms 

Many Arms in Europe regard in-house continuing training as a central instrument for 
achieving economic gods. Improving the skills and knowledge of workers has become 
an essential factor in terms of business competition. Continuing training is seen as an 
investment, which has to be properly planned and assessed. 

The quality of such training is therefore measured in terms of the contribution it makes 
to strategic and economic success. The quality of the content and methods tends thus to 
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take a backseat, being a factor merely in assessing the indirect effectiveness of training 
measures, but not as a factor in its own right. Vetting procedures which serve to assess 
the cost-effectiveness of continuing training play an important role. 

In the documented case studies, the important thing is not to assess the quality of 
particular courses and seminars, but rather to gauge the quality assurance of the entire 
training process by reference to the various phases: 

• project planning and organisation 

• ascertainment of needs 

• conceptual development 

• participant information and counselling 

• training proper 

• practical experience (where appropriate) 

• testing/certification 

• practical application. 

The difference between the various cases is that different pickers are responsible for the 
quality assurance of in-house training measures. As a rule, evaluation and quality 
assurance are the job of the firm's human resources or training departments. In some 
cases, though, other groups are involved, e.g. management, the participants' hierarchical 
superiors or the participants themselves. In such cases, the evaluation exercise meshes 
closely with the firm's actual requirements. 

In all cases, the basic criterion for quality assurance is the success or otherwise of 
practical cpplication. Thus, training courses are designed specifically to correspond to the 
workplace requirements. In many cases, the question is left open as to how more general 
requirements - e.g. in terms of "across-the-board skills" - can be evaluated and converted 
into training design concepts within the context of quality assurance. 

In most cases, ISO EN 9000 is used as a basic yardstick, with certification applying either 
to the firm as a whole or to its training department. 

New requirements in terms of quality assurance in in-house training arise from the more 
widespread use of innovative forms of in-house teaching, e.g. computer-based training, 
open learning, open distance learning, project and group learning. All these forms seek 
to create a closer link between work and training. As a result, quality assurance in 
vocational training now has to address subjects which used to be of no concern to it, e.g. 
organisation of the work process, the training-friendliness of particular work 
environments, the pro-learning design of workplaces, etc. 

5.1.2 Summary : Quality assurance in terms of cooperation between firms and trcdning 



It is evident from all the documented cases from the nine Member States that cooperation 
between firms and external training providers is becoming increasingly important, both 
for large business and for small and medium-sized undertakings. 



providers 
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In terms of such cooperation, the essential task of the quality assurance component is to 
keep a check on, and optimise, the various phases of the training process and the process 
as a whole, with a view to making constant adjustments to quality. It is also concerned 
essentially with coordination between the firm and the training provider, a process which 
is made difficult where two parties have to address the same process from differing 
angles. 



• Large firms tend to deal with this problem by taking the lead themselves in 
quality assurance and giving the training provider precise details of the task at 
hand, ascertaining themselves whether the result has been satisfactory. 

• Small and medium-sized undertakings are, in most cases, imable to play this 
dominating role and are dependent for their planning and quality assurance needs 
on external help. 

• Training providers address the subject in different ways. Some of them take on 
the quality assurance role themselves in cooperation with firms. This is 
particularly true of providers with a strong sector-oriented backgroimd; they tend 
to analyse likely training needs and incorporate firms' expertise into their own 
organisational processes. Other providers obtain certification imder ISO EN 9000 
or equivalent national standards as a way of preparing for improved cooperation 
vvith firms. It has to be said, though, that in addition to the documented 
"exemplary training providers", Europe has a large number of providers for whom 
"tailor-made" and "quality assurance" are unknown terms. 

Cooperation between large businesses and training providers will continue to be dictated 
by the dominance of large businesses in matters concerning vocational training; at the 
same time, though, something needs to be done to create appropriate forms of cooperation 
between small and medium-sized businesses and the training providers (these being of 
great importance to Europe's economy). With a view to improving the quality of such 
cooperation and to quality assurance considerations, both sides need support in the form 
of information, practical assistance, resources and instruments. 



5.1.3 Summary: Quality assurance and structuring of the vocational training market 

The basic principle imderlying the way individuals and firms are supplied with continuing 
vocational training is the market principle. All nine Member States have a continuing 
training market in which the State intervenes only as a regulator, providing back-up and 
subsidiary assistance for particular target groups. 

It therefore follows that quality assurance services are provided very largely via market 
mechanisms. Quality can be assured in various ways: 

• Training market’s own resources: Alongside price, the quality of training is an 
essential element in achieving market success. The way training is marketed has 
a retroeffect on the quality of training provision. However, a number of case 
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studies indicate that there are functional problems in the market which might 
adversely affect the quality of continuing training. 

• Improving market transparency: Lack of transparency on the training market 
means that the provision of information and advice is an essential quality 
component in training supply. In some cases, information centres are a public 
institution or are at least run by more than one association or institution. They 
have the advantage of helping clients to compare the quality aspect of whatever 
training is on offer. 

• Self-cppraisal by training providers: Many training institutes devise and publish 
their own quality standards voluntarily and undertake to apply them in their 
dealings with clients. In many cases, compliance with such standards is overseen 
by independent organisations. 

• Certification of diplomas and certificates: One indirect way of checking on the 
quality of training institutes is by way of recognised certificates and diplomas 
resulting from tests or examinations; the success rate gives an indication of the 
quality of the training. 

• General standards: On the vocational training market, the importance of general 
standards for the quality of such training is very much on the increase. Many of 
the case studies report on ISO standards, national quality standards for continuing 
training or sectoral quality guidelines. 

• State intervention: Member States are increasingly influencing the continuing 
training market by their activities aimed at coordinating public-sector funding of 
continuing vocational training and through direct statutory intervention. In many 
cases, the quality of the training is the prime criterion. 

The continuing training market is bound to undergo lasting change in response to more 
intensive efforts to impose quality assurance standards. Training institutes will 
increasingly have to produce evidence of quality and, in some cases, even open up their 
internal quality assurance system for inspection by their clients. The days are gone when 
they were able to see themselves simply as a separate service-provider, offering ready- 
made products; nowadays, they are judged by whether they can react flexibly to varying 
quality requirements on the part of firms and individuals. 



5.1.4 Summary: Quality assurance and wc^s of improving the quality of continuing 
vocational training 

To avoid the risk of too much red tape and short-sighted cost-cutting, and at the same 
time to realise the innovative potential of the quality assurance approach for continuing 
training, the experts endorse the conclusion drawn from the national studies that further 
development and research work is necessary. 
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• The formal requirements addressed to training managers in firms and to training- 
providers, as described in national or international quality standards and 
procedures, must be given a teaching-related content and kept under close scrutiny 
to ensure that there is a genuine improvement in teaching standards. 

• Small and medium-sized businesses in particular must receive external help from 
training providers in the quality assurance process (cf. Chapter 2); they must not 
be put off by complex regulatory systems for quality assurance. There is a need 
for simple methods for small and medium-sized businesses which are based on in- 
house practice and on the available staff and material resources, leading to 
training activities being properly integrated into everyday business life. The 
quality certification of training providers can, in such cases, help to improve 
market transparency. 

• To ensure that the quality assurance approach is not reduced to mere cost- 
conscious vetting systems, the important thing is to take up the evaluation issue 
and find practicable ways of deciding on success indicators and how to measure 
success. A central role here has to go to the systematic encouragement of self- 
assessment. 

• There is also a need to evaluate the purely technical side of learning and teaching. 
As far as optimising the learning effect is concerned, there is an urgent need for 
ways of assessing various learning methods under practical conditions. Here again, 
self-assessment on the part of learners and teachers is an important aspect. 

One thing that should always be borne in mind is that it is not the formal requirements 
of quality management which improve the quality of continuing training. The real success 
comes from the next step, i.e. the active participation of all the firm's workers in the 
process of thinking about and optimising the training arrangements. In terms of giving 
content to abstract quality assurance standards, what is heeded specifically here is a 
procedure which guarantees the active integration of workers at all levels of the training 
process. There are plenty of examples of this in the case studies. Devising practical 
procedures here would be a useful exercise for all companies in Europe, and particularly 
for the small and medium-sized ones. 



5.2 Quality assurance in continuing vocational training: 

Problems and outlook 

The experts' appraisals in the national studies on quality assurance in continuing training 
reveal quite a number of problems and avenues to be explored. 

There can be no doubt that methods of quality assurance have not kept pace with the 
expansion and growing importance of continuing vocational training Europe. Experience 
over the past few years has shown that abstract methods of quality assurance and methods 
derived from other sectors in the field of continuing training have failed to generate 
satisfactory results. What are missing are special procedures for quality assurance in 
training: 
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• The correct application of quality assurance systems and methods in respect of 
continuing training must be guaranteed and made operational at all levels of the 
training process. In other words, the first step must be to convert formal quality 
management or quality standard requirements into specific training processes. 

• The application of quality assurance systems to continuing vocational training 
tends to highlight "old" shortcomings on the training scene when seen firom a 
different perspective. For instance, the absence of adequate evaluation methods 
and instruments has long been a subject of debate among training specialists. So 
far, though, the debate has remained largely academic and has generated no 
practical consequences. For quality assurance, though, evaluation is a conditio sine 
qua non. 

• The quality management of continuing training creates interactive effects for the 
"corporate culture" and for the way firms and work are organised. 

The quality of in-house continuing training is being measured increasingly by reference 
to the creativity and innovative potential of the firm's workers, i.e. those receiving the 
training and who will be required to contribute to the future competitiveness of the firm. 
Such potential can only be realised by making appropriate changes to corporate structures 
and processes. 

Taking the structure of this report as a guide, we shall now take a look at the deficits in 
terms of in house vocational training quality assurance which emerge from the case 
studies in the nine Member States. The summaries of the experts' opinions and the results 
of the case study analyses might constitute a suitable basis for proposals on pilot projects 
and research projects under the Leonardo programme. 



5.2.1 Quality management and quality assurance in firms 

• Quality assurance in respect of in-house learning arrangements 

In many pro-learning, irmovative companies, in-house training is closely meshed 
with the actual working process, either through special forms of learning (i.e. 
workplace-related skilling, using production staff as instructors, conducting 
business audits) or through some organisational form of linkage. At the same time, 
the quality assurance aspect usually concentrates on optimising training measures, 
rather than addressing the general in-house training environment. So far, we have 
seen only very few instances of quality assurance which incorporate targeted 
changes to the in-house learning environment: e.g. the design of leaming-fnendly 
workplaces, training up in-house "multipliers", the organisational integration of the 
training department and specialist and line departments. Given the strategic 
importance of in-house training, such concepts would lend themselves to a holistic 
approach to quality management. 

• Using teaching methods as a basis for evaluating in-house vocational training 
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Many firms regard continuing training as an investment warranting considerable 
care and attention. Perceiving the skilling of employees as an investment factor 
accords with a form of evaluation and quality assurance which is geared in the 
first instance to business parameters. Quite apart from the still unresolved 
theoretical and methodological problems of how to evaluate training input, this 
kind of approach to training has hitherto existed side by side (but unconnected) 
with more work-related and learning-psychology methods of evaluation. We shall 
in the future see the gradual development of concepts for operationalising and 
modifying such work-related and learning-psychology methods so that they 
become readily usable in firms and by training providers, and which render them 
compatible with more business-oriented quality assurance concepts. 

Involving co-workers in the quality assurance of in-house training 

Chapter 4 in particular emphasises the central importance of involving co-workers 
in the process of vocational training quality assurance. By getting staff to reflect 
on the appropriateness and effectiveness of continuing training, the result should 
be to turn formal quality management rules into the feedstock for genuine 
improvements in the quality of continuing training. In other words, the success of 
quality assurance measures stands and falls with the active involvement of those 
concerned at all levels. This is in line with the stated views of the Member States' 
national experts. Some of the documented cases provide evidence of what firms 
are doing to secure such involvement. So far, only very few of the firms covered 
by the case studies have concerned themselves with worker involvement. Such 
questions concern the organisational aspect (planning groups, consultation 
exercises, training circles, etc.) and the human resources aspect (e.g. awareness 
training, motivation and worker empowerment). 

Quality management systems based on ISO EN 9000 

The certification of training providers and in-house training departments imder 
ISO EN 9000 is acquiring increased importance throughout Europe. The ISO 
standard itself does not set out criteria for the content of vocational training, being 
conceived as a procedural norm for quality assurance in all sectors. It can 
therefore be applied bureaucratically without really doing anything to improve the 
quality of vocational training. No attempt has so far been made - at least as far 
as is discernible from the documentation - to give any real vocational teaching 
content to the quality objectives, criteria and indicators in the ISO certification 
procedure — neither in practical cases nor in the scientific accompaniment to 
certifications. It is likely, though, that the documentation and publication of 
teac hin g guides and manuals will take the massive increase in training 
certification in certain Member States as a starting point for making qualitative 
improvements to vocational training systems. 
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5.2.2 Improved cooperation between firms and external training providers 

The drive for quality assurance in vocational training must embrace all those involved in 
the continuing training process if there is to be a lasting improvement. In real terms, this 
objective goes beyond the limits of individual firms and increasingly frequently leads to 
cooperative efforts between firms and training providers. Of particular interest here are 
collaborative moves involving small and medium-sized businesses and training providers, 
although cooperation between large firms and external trading providers is also giving rise 
to new forms of cooperation on the quality assurance front. 

• Helping firms to draw up specifications for cooperation-minded training providers 

It is evident from some of the documented case studies that many large businesses 
draw up their specifications so that the services rendered by external training 
providers fit in almost effortlessly with in-house quality assurance procedures. 
These formalised cooperation processes enable the various parties in the firm to 
get used to dealing with external training providers. Tailor-made training is one 
of the benefits of a well thought-out corporate strategy. At the same time, the 
clear statement of requirements helps the training providers to gear their services 
to the needs of the customer. Many firms in Europe currently do not have the 
requisite know-how to produce specifications for continuing training. Too few of 
them are in a position to assess what training providers can deliver, and too few 
are aware of the new forms of vocational learning, etc. 

• Quality assurance as a form of cooperation between small and medium-sized 
businesses and training providers 

Whilst, as a general rule, large businesses plan their training management and 
quality assurance methods as an in-house strategic operation, and only use training 
providers for certain specified tasks, this is not the case for the majority of small 
firms. Cooperation with external training providers must be much more broadly 
conceived in this respect. Strategy-development, planning, implementation and 
quality assurance must be seen as a joint process for cooperation between the 
training provider and the firm. In such cases, training providers assume functions 
which, in large business, would be the task of the company's own training 
department. Training requires extensive consultation, planning and evaluation 
work, and throughout the process it is important that the necessary intensive 
cooperation does not overstretch the staffing, time and financial resources of small 
and medium-sized businesses. In such cases, quality assurance comes down to the 
quality of cooperation between the firm and the training provider. The important 
thing is to take the wide range of forms of cooperation between small businesses 
and training providers (of which there are already examples in Europe), devise 
transferable procedures and make these procedures available as simple aids for 
firms and training providers alike. While such practical instruments, materials and 
procedures often involve the training providers in major reorganisation (but also 
open up new areas of business), the organisational aids for small businesses must 
be based on the practical possibilities open to such firms. It is important to 
remember that it is not simply a matter of transferring large businesses' procedures 



to the smaller firms. The particular strengths of small firms - e.g. direct lines of 
communication between all members of the firm - can be put to systematic use 
in the quality assurance of continuing training. 

Sectoral and local cooperation between firms and training providers 

The documented case studies on sector-oriented training providers focus quality 
assurance efforts in cooperation with firms on the central concern of gearing 
training to firms' particular needs. Training providers can then adapt more 
specifically to the procedural needs of a particular business sector, which makes 
it easier to plan and implement place-of-leaming combinations, the use of 
particular media, seminar release arrangements, etc. according to the firm's 
requirements. 

Quality assurance in such cases takes the form of a range of organisational and 
procedural structures, making it possible for training providers to anticipate and 
prepare for cooperation with particular firms in response to sectoral needs. It is 
important to remember that it is only at the stage of concrete cooperation with 
particular firms that it becomes possible to evaluate the cooperation process. 

It is a fact, though, that experience in the application of quality assurance 
procedures by sector-oriented training providers is not available in the same 
intensity for all sectors and for all Member States. 

In some cases, concepts for boosting cooperation between firms and training 
providers depend on the two sides being physically close to one another. 

As set out in the White Paper on growth, competitiveness and employment, and 
as mentioned by IRDAC, cooperation with small businesses may take the form 
of multiple local or subregional networks. This is a good way of finding out 
exactly what the regional needs are in terms of continuing training; additionally, 
local cooperation networks are the best form of covering the wide range of 
information and consultation requirements. Within the context of a "learning 
region", quality assurance thereby assumes the duties of running the network by 
reference to the strategic objective of regional personnel and employment 
potential. 



5.2.3 Evaluation as part of continuing training 

Quality assurance in continuing vocational training stands and falls with the way the 
various elements involved in the training process are examined and assessed. 

• Process evaluation 

Quality assurance in continuing training is formative process evaluation, i.e. 
evaluation takes the form of a continuous monitoring of the training process and 
the ongoing adjustment of the process to allow for errors and improvement. 



Existing methods of input and output evaluation are not rendered obsolete, since 
they remain the basis of all forms of training evaluation. However, such methods 
are no longer used exclusively at the beginning or end of the overall training 
process. If the ongoing process is to be properly "accompanied", there must be 
more input/output evaluation points throughout the process. What we lack are 
transferable criteria, measuring conventions and measuring instruments which, at 
all stages of the training process, mesh systematically and are both objective and 
practicable. This is true of the analysis of training requirements, the learning and 
teaching process and the application transfer function. Only where such 
procedures, methods and instruments are available is it possible to carry out a 
proper process evaluation and secure the ongoing quality of the training provided. 

Transferring methods of teaching evaluation to the sphere of continuing vocational 
training 

The need for appropriate evaluation methods applies to the teaching side as well. 
Testing and assessing teaching and learning arrangements in continuing vocational 
training is central to the cause of quality assurance. So far, the discussion on 
framework conditions, formal procedures and the education policy implications 
of continuing training has had little or nothing to do with evaluation research on 
the teaching side, which has in turn been concerned very largely with the learning 
factor alone. The results of teaching evaluation theory have hitherto made very 
little impact on the learning process outside teacher training and research 
institutes. At the same time, very little development work has been done on 
evaluation instruments which are readily applicable in firms - wherever possible 
by the people actually doing the learning. However precise the psychologists' 
measuring methods may appear, they certainly do not lend themselves to 
continuous application in the business environment. Virtually nothing has been 
done to explore the ways in which scientifically devised evaluation instruments 
can be made usable in the day-to-day practice of in-house continuing training. As 
such, there would appear to be a particularly urgent need for handbooks and 
documentation on ways of evaluating such training, to be measured against the 
extent to which they can be used in firms without any external assistance once the 
project phase is over. Obviously, in-house training practice is not the right context 
for trying out research designs with control groups. The point here is not research 
for its own sake, but the best possible process design. Nonetheless, documentation 
designed for evaluating in-house learning arrangements can be a great help in 
investigating teaching and learning processes in vocational training. For one thing, 
it is only here that the effects of differing learning arrangements can be monitored 
under practical conditions; for another, what we have here is a thousandfold 
proliferation of field trials in a form which could never be achieved in scientific 
experimentation. 

Concepts for self-assessment in continuing training 

It is entirely within the logic of quality assurance in vocational training and in 
keeping wiA the natvire of modem management systems that all those concerned 
with the evaluation of training processes in firms - particularly the participants 
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themselves - should be required to assume more responsibility and be empowered 
to take their own decisions. Self-assessment has the potential for becoming the 
form of continuing training evaluation - and hence an essential element in the 
quality assurance procedure - provided certain conditions are met. 

The individual worker is the key to the complex requirements of modem firms, 
and is at the same time central to firms' continuing training efforts. As such, he 
becomes the main source of information regarding the quality assurance aspect of 
in-house training, being best placed to provide information on what training is 
needed and how successful training courses have been. 

If self-assessment is to play its part as the true source of improved training 
provision, firms need to develop a new, more open corporate culture with the 
requisite level of self-criticism to enable skills deficits to be identified and 
learning problems addressed without workers having to fear negative 
consequences for their own careers. Workers who have identified shortcomings 
in terms of know-how or skills must get the chance to make up those deficits 
without any negative stigma attached. 

Self-assessment makes people more self-assured, and this is only possible if there 
is an ongoing feedback process with third-party evaluation. People's own appraisal 
of their potential, problems and limitations must be discussed in a confidential 
atmosphere with groups of colleagues or their superiors, this being the only way 
to acquire both the necessary critical distance and the essential self-assurance. 

The case studies show that, even in firms which are committed to training, the 
only self-assessment methods used (if at all) are informal ones. Very little work 
has gone into developing transferable, formalised methods and instruments of self- 
assessment. These methods have to be seen not just from the point of view of 
individuals (what resources, know-how and skills are needed if self-assessment is 
to be a success?) but also from the angle of practical implementation in the firm; 
How can they be integrated into existing corporate hierarchical structures? 
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5.3 Concluding remarks 



The present study on "Quality assurance in in-house continuing training" makes available 
the thematically prepared basic material on the present state of quality assurance in 
continuing training, based on the nine individual studies from the Member States. This 
material has been compiled and analysed in accordance with the specifications of the 
Steering Committee of the FORCE/EUROTECHNET Advisory Committee, and the 
thematic focal points which were approved at the meetings of that body. 

The specification also calls for the synthesis report to form conclusions, on the basis of 
the national studies, regarding future prospects, problems and development trends in the 
field of quality assurance in continuing training. Comments regarding this are to be foimd 
in the individual chapters, and in concentrated form in [Chapter 5.2]. Clearly, it cannot 
be the function of an expert report to formulate conclusions regarding further 
consequences for training policy or practical options associated with that policy. This, in 
due course, will be the function of the authorized committees or of the representatives of 
the Commission of the European Union. The present report is to be considered as an 
information base for such decision processes. 
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ANNEX: SUMMARY OF THE NATIONAL CASE STUDIES 



This synthesis report is based on national studies of quality assurance in continuing 
training which constitute case studies for the application of quality assurance methods 
within firms. In the annex which follows, the authors of these case studies briefly 
summarize the status and future prospects of quality assurance in continuing training in 
their respective countries. 
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Johan Decramer 

A.1 Survey on quality in continuing training - Summaiy of the contribution of 
Belgium, the Flemish Community 

The contribution the Flemish Community of Belgium, consists of a description of several 
cases in order to demonstrate the major areas of concern the partners in the landscape of 
continuing training have to face nowadays. 

Continuing training has become a necessity for all workers and is not any longer a 
privilege for large organisations. All partners recognise that attention should go to 
continuing training of employees in Small and Medium Sized Enterprises and that 
therefore the co-operation between firms and the providers of training should be 
improved. It is also necessary to strive for a better co-operation between the different 
providers, private institutes, subsidised and governmental organisations and sectoral 
federations as major role players, and for an increasing transparency in the market. 

All described cases illustrate that training providers are aware of the need for better a 
-quality control- of the training-process and are working on quality from different points 
of view. As a general conclusion we can say that there is a great need for better 
communication between the different partners, providers and buyers. Dissemination of 
good practice in the field of Continuing Training will become possible through a better 
understanding of the importance and the relevance of modem quality approaches and 
through the definition and the use of a common vocabulary. 

The gathering of the cases does not pretend to be exhaustive nor it is an assembly of 
success-stories. The general idea was to give a overview of the major concerns some 
main training-providers in the Flemish Community are dealing with. 

Case 1 describes the aspects of quality concern of a Training Institute for SME (Vizo), 
providing training to managers, self-employed entrepreneurs, staff members and 
executives of SMEs and family enterprises. 

The major concern of VIZO is to install a culture of TQM (Total Quality Management) 
within the organisation in order to scope with the changing needs of the market. Major 
areas are 

the quality of the design and the development of new training 

the quality of the communication with the market and the marketing efforts 

• the quality of the training provision itself (projectmanagement) 

• the planning of a system for quality measurement 

Case 2 shows the efforts of a government training provider, the Vdab (Flemish 
Employment and Vocational Training Service) is making to apply the management 
guidelines offered by the ISO standard as guide and instrument for controlling the training 
process. 

The aim of this Quality Program was not to actually obtain the ISO-certification, but to 
guarantee the quality of training. Quality Policy of the management has been expressed 
as follows: 

we will give clear and correct information about our offer to all possible customers and 
this in the most adequate and accessible way 

we want to adapt our program to the actual and changing needs of the labour market 
1 we will make clear agreements (contracts) with all customers, and this in all 
phases of the training process 
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the progress of every student in the training process should be traceable and 
demonstrable by means of written documents 

evaluation should include proper and useful information on the result of the 
training 

Case 3 illustrates the efforts made to develop computer assisted programs for selfstudy 

and training other than the classical training suitable for the -average- student. The 

private institute Ckz (Centre for Total Quality Management, Consulting, Training and 

Information) lists the advantages of such training packages as follows: 

instruction at an individual pace and adapted to the learning capacity of each student 

a flexible use at any time and place, according to the production process 

a built-in feedback and evaluation system which allows the students to take greater 

responsibility in their learning process 

the added value of the instructor goes more in-depth 

Cases 4 to 6 are examples of different approaches to evaluate training. 

Case 4: Ehsal Management School uses a customer satisfaction measurement-system as 
a technique for quality control. Even if customer satisfaction measurement is a result of 
a subjective feeling and the perception of the customer, it can deliver relevant information 
for evaluating the trainers and the training. In order to be workable as an instrument for 
quality control, the measurement system should involve: 

the assessment of immediate perception of individual performers (trainers) and individual 

contributions within the larger framework of the entire cycle 

the processing of the result (quantification, analysis and interpretation) 

actions towards adjusting, complementing and updating the existing supply 

Case 5: the Government of the Flemish Community did a great effort to launch a training 

program to train all levels of the administrations as part of a so-called Investment- 

program for training. The case describes the many instruments and channels used for 

evaluating the training. The main conclusion is that evaluation is merely based on the 

subjective perception of the participants. Measuring real effects on the participants is only 

possible if aims are made explicit in advance (in department-oriented training, and in 

courses intended for specific target group). 

Case 6: In 1994, the authorities charged all local administrations to develop a training 
plan for all employees as an important instrument of HRM. In the organisations, detection 
of needs, contracting suppliers and evaluate the result of training, are very new. In despite 
of the fact a training officer was designated in every administration, response to all offers 
was very small or not relevant for the functioning of the trainee. The key bottleneck in 
the communication process appeared to be the first-line supervisors of the departments. 
In order to structure the communication between the local administrations (the demand) 
and the VDAB (the supply), VDAB-s trainingmanagers developed a simple sheet that 
make possible to register all necessary agreements that have to be made during the 
process: 

the supervisor of the trainee makes agreements with the trainee on possible topics for a 
course, the time that can be spent, expected results 

the supervisor agrees with the VDAB-instructor on objectives and the time available 
3 the instructor makes evaluations during the course and at the end (orally with the 
trainee and registered on the sheet) 

• the supervisor and the trainee make the final evaluation which include new 
agreements for functioning and further education 
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Case 7 illustrates the major shilfts in the training strategy and the changing role of the 
training department in a large organisation. Being situated in a rapidly changing 
environment, Atea is confronted with an increasing need for very high qualified 
personnel. Speed, volume and complexity of the needed training have an impact on how 
training is organised in the company. Three major shifts in training strategy can be 
identified: 

The training department can-t vuild up an -expert— team with trainers attached to the 
department. Expert-employees, remaining in the operational services are made responsible 
for training the -non-expert- employees. 

Year programs and classical coiuses have become outdated. The need for individual 
courses, delivered at the right time and adjusted to the individual needs, requires a 
complete -rethinking- of how to organise training. 

Continuing training becomes more and more a matter of self-development of the 
organisation. Training department must see it that training budgets are well spent. The 
role of the training department changes from trainer to facilitator in the field of transfer 
of knowledge/experience/information. 
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Dieter Lellmann 



A.2. Case studies on quality assurance in continuing vocational trainii^ in die Federal 
Republic of Gennany 

In the course of historical development, because of the very nature of the continuing 
vocational training system in the Federal Republic of Germany, different forms of quality 
assurance have emerged which are only valid and justified for certain sub-areas. 

The German case study deals with four examples of quality assurance in continuing 
training from different sectors: 

- The "quality order" of the Federal Institute for Labour, which relates to the 
sponsored continuing training of the unemployed; 

- The award of multi-provider quality seals by the "Weiterbildung Hamburg e.V" 
association; 

- The certification of training providers under EN ISO DIN 9000 et seq. by 
CERTQUA GmbH 

- Consumer protection activities: the Goods Testing Institute and the Distance 
Learning Protection Act. 

The effect of the "Quality order" for sponsored continuing training for the unemployed 
was to tidy up the quality aspects of the training provider scene and increase the 
suppliers' quality awareness. A good deal of tightening of the supervisory activities of the 
Federal Institute for Labour was entirely in the interests of the training providers who, 
after all, have partly developed the quality of their services independently of the 
requirements laid down by the Federal Institute. Since quality standards essentially verify 
input quality, their ftmction is primarily to provide information and guidance to the 
employment offices. To what extent they perform supervisory and selection functions in 
practice is debated. However, an intensification of the supervisory procedure by the 
employment offices has resulted in the discovery of various measures which suffer from 
substantial quality defects. One of the problems with the Federal Institute's quality orders 
lies in the fact that administrative personnel are responsible for examining teaching 
activities; an attempt has been made to resolve this dilemma by providing internal 
training to the employees of the employment offices. It is also regarded as problematical 
in principle to implement quality standards by means of administrative supervisory 
machinery alone. 

The quality seal award of the Vereins Weiterbildung Hamburg e.V. is based on the model 
of self-monitoring by training providers. It is assumed that the public propagation of 
"quality standards in continuing training" and the award of quality seals to date has 
resulted in an enhancement of the quality of continuing training services in Hamburg. The 
result of the transparency of the quality criteria has been that consumers of continuing 
training have reliable guidelines available. The importance of the Vereins Weiterbildung 
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Hamburg e.V. lies not only in the advisory service it provides to its members, and hence 
in the creation of uniform quality standards, but also in its consumer advisory service. 

CERTQUA GMBH is a joint foundation by the leading German industrial associations 
(the Federal Union of German Employers' Associations, the German Industry and 
Commerce Day and the Central Association of German Crafts) and Wuppertaler Kreises 
e.V. The work done by CERTQUA GMBH and possible additional new foundations with 
the aim of certifying trading providers under EN ISO 9000 et seq. also helps to make the 
providers more quality-conscious and results in their setting up quality assurance systems 
if they want to achieve certification under the ISO. The criticisms levelled at CERTQUA 
relate to the question of its independence, which is regarded as a problem by the unions. 
Pluralism among suppliers of certification, however, already exists today; with the wave 
of ISO certification in the training sector, it is possible that other suppliers - some of 
them already established in industry - will offer certification services for training 
providers. Irrespective of this, the question is also debated as to whether, because of the 
extensive formalism of the ISO certification procedure, rational definitions of quality 
assurance standards can be expected. 

The case studies make it clear that the debate about quality standards and quality 
assurance systems in continuing vocational training in Germany has progressed in recent 
times and has produced positive effects on the transparency of continuing vocational 
training and the quality consciousness of those involved in continuing training. The cases 
described are quality assurance measures based on active involvement by the players in 
vocational training and so not jeopardizing the variety and flexibility of the services 
available. Quality awareness has become more acute among many training providers and 
participants in continuing training. 
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A.3. Context and description of quality measures in vocational training in France 

A.3.1 The context of the quality question in vocational training in France 

The quality issue did not really become a major one in vocational training circles until 
the late 1980s. It then rapidly became a major preoccupation both for firms who made 
use of the services provided by the training bodies and to those training bodies 
themselves and the public authorities. It gives rise to planning and collective efforts, it 
leads the main players to clarify their strategic orientations and policies, and it results in 
the setting-up of measures which modify existing practices and potentially carry a 
powerful capacity for restructuring the available training services. 

This increase in the importance of problems associated with quality can be attributed to 
a number of fundamental changes which training has undergone in France: on the one 
hand, the dynamic of the construction of a market for the provision of training services; 
on the other hand, the ascendency of a commercial logic with regard to the training 
service and the service contract; finally, the differentiated activity of various poles of 
players in a context in which economic pressures have become much stronger. 

Uncertainty regarding quality goes back to the origins of the continuing training system 
established under the auspices of the Law of 16 July 1971. That Law established 
compulsory participation in the financing of vocational training and required firms to 
devote a given percentage of their wage bill to it. 

Even when that Law was at the planning stage, it had been noted that contemplating 
setting up a broadly based training market, funded by a compulsory contribution from 
employers, while Ae operators concerned were few in number, had the potential to 
generate tension. The need to encourage new operators to move into this sector, in the 
knowledge that the employers' compulsory involvement should have risen from 0.8 % to 
2 % of the wage bill between 1972 and 1976, was to result in quantitative targets being 
given preference at the expense, up to a point, of a more harmonious development of 
training activity. It was for this reason that bodies which wished to operate in the training 
market were subjected only to minimal rules governing the exercise of their activities. 
Those rules are restricted to recording their intent to enter the market (declaration of 
existence) and to the a posteriori description of the activities they carried out 
(instructional and financial balance sheet). 

Today, the supply of vocational training is characterized by being dispersed or broken up 
among a large number of training bodies. For the majority of players, their involvement 
in it is only a secondary activity, their main concern lying elsewhere. Only 15 % of 
bodies earn the majority of their turnover from vocational training. 

The question of the quality of vocational training has gradually become more of a focal 
point. This is because the imposition of minimal supervisory rules has not really made 
it possible to ensure transparency in a market which is often considered opaque even by 
those involved in it. This uncertainty relates not to the training itself, or its utility, but to 
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its production - to the training bodies which furnish it and the relations between them and 
the trainees. By the Law of 1990, the legislator made specific efforts to organize the 
relation between the training body and the trainees, and so laid the initial groundwork for 
a "consumer right" focused particularly on the teaching contract. 

In order to characterize the background to the case studies, the report briefly outlines the 
changes in position of the main players (firms as the customers for training; the State as 
the market regulator; and the training bodies as suppliers of training services) relative to 
the question of quality and the various routes they have followed to arrive at a way of 
guaranteeing the quality of the training they produce or consume. 

A.3.2 The extension factors of quality activities in vocational training 

The case studies of firms (large firms and SMEs) and training bodies show that quality 
activities in vocational training are expanding vigorously today. They are the result of the 
number of trends which are having a powerful impact on the organization of training by 
firms or by the State, and on the training services supply structure. 

a. The full force of the slowing-down of the economy from the end of 1989 was felt 
by the service activities, and specifically by training services, which were 
confronted by stricter conditions in terms of organization and purchase volume by 
most of those who commission services from them, both in the private and in the 
public sector. The reduction in the volume of training, the revision of the criteria 
for awarding contracts, the greater attention paid to verifiable evidence of the 
quality of the services supplied or their results, and the relative fall in the price 
of services have created serious tensions in the market, so that some bodies have 
got into difficulties or gone out of business. 

b. These changes have given a powerful boost to collective platming and the 
implementation of quality measures. The standard apparatus that has been set up 
is an initial response, but one that is incapable of solving all the problems. 

For those who purchase training, greater transparency in the market is appreciated and 
the pressure they have brought to bear enables them to benefit from a relative drop in 
prices; it can be noted that greater control over demand, as in large firms or, in the longer 
term, as in the SMEs, is ultimately reflected by an increase in needs: the firms would like 
to do more with a reduced budget. The question could then shift away from a focus on 
the internal organization of the training bodies (the instrumentalization of quality focuses 
on the provider's organization) towards a concern with quality management which would 
include the necessities of more efficient provision of services. 

c. The case studies show the importance of the changes that have taken place over 
the last few years: 

- the adoption by large firms, and also by the small and medium-sized 
enterprises, of devices intended to submit training to quality control. The 
variety of means selected bears witness to the quest for fine tuning to the 
specific needs of each of these categories of firm. 
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the end of the pioneering era: the instmmentalization of quality by the 
training bodies is no longer only a differentiation factor but also an 
essential "survival" reaction in a particularly stretched market. The quality 
requirement places the emphasis on the transformation of the bodies' 
internal organization, the ways in which they provide information and, 
ultimately, their capacity to meet their customers' demands. This 
transformation goes hand in hand with a transformation of the supply 
structure characterized, in particular, by a move toward concentration of 
the training bodies, which have hitherto been very dispersed, 
the quality meeisures which have been effected and adopted, at leeist eis 
regards the cases presented here, exhibit a particularly radical cultural 
change. They all emphasize written procedures, audits based on verifiable 
documents, etc. There is, then, a relative break with the "oral culture" 
tradition which characterizes the profession; but the new practices which 
these measures have generated are also an expression of deep and long- 
standing arguments which have mobilized the profession. The quality tool 
seems to adapt particularly well to training, by providing it with 
management methods and tools which have previously been lacking in a 
sector initially notable for the academic approach. 
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A.4 Quality in Continuing Vocational Training in Greece - Summary 
A remarkable development of continuing vocational training activities has taken place in 
Greece during the latest decade due to a growing demand that is mainly being propelled 
by companies undergoing profound structural, technological and organisational changes 
and by employees/workers facing the resulting transformations in their professional 
knowledge, skills and attitudes required for their employment. A complex network of 
public and private agencies has set up offering vocational training to employed and 
unemployed persons that is being developed side by side but clearly apart from the formal 
vocational training system along with the majority of large companies that organises and 
implements training activities for its personnel. 

The expansion and diversification of this informal continuing vocational training network 
is taken place on a heterogeneous legal ground and in this context as no approval or 
recognition of the State is required by the providers the continuing vocational training 
market in Greece is open and is characterised by the multiplicity and diversity of 
suppliers and supply and by the subsidiary role of the State. Among the continuing 
vocational training providers are included public authorities and State controlled 
organisations, universities and educational institutions, professional associations and 
chambers, organisations set up by employers- and employees- unions, regional and local 
authorities establishments and private human resources development and training 
agencies. 

Despite however a such considerable expansion of continuing vocational training activities 
the questions of quality have only recently begun being widely discussed and gaining in 
importance within the private and public training agencies and especially within the 
responsible State authorities, notably for reasons of public accountability, training market 
transparency and training effectiveness given that the majority of the continuing 
vocational training activities in Greece nowadays are being co-fmanced by public services 
and EU-s funds. 

In this context five cases representing the national scenery of continuing vocational 
training and having a direct relation to the training in enterprises or for enterprises and 
their employees have selected and their applied measures in quality assurance and in the 
effectiveness evaluation of their training ventures have being concise reported. 

The main lines of the debate on the questions of quality in continuing vocational training 
that is ongoing in Greece nowadays are also being reported in brief From this debate and 
from the relevant proposals and plans that are being publicised in its context a common 
approval of the necessity for establishment of a minimum set of quality standards and of 
quality assurance systems for the continuing vocational training structures and for the 
training activities is being got up although not being advocated by identical arguments. 
The governmental intervention towards such a direction that has taken place by the 
foundation of a National Certification Centre of Continuing Vocational Training 
Structures and the activities that The Vocational Education and Training Organisation 
(OEEK) is already developing or designing that are strongly shaping the context and the 
orientation of the current debate on the quality in the continuing vocational training are 
also being briefly reported. 

Besides the most crucial factors that is being got up both from the reported cases and 
from the current debate and the relevant initiatives that are nowadays taking place in 
Greece on the quality in continuing vocational training that seems to be considerably 
confusing the subject matters and at the same time may to be virtually retarding the 
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application of any befitting measures on the quality assurance in training are being 
summarised. 
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A.5 Quality Survey of Irish Continuing Training - A survey of continuing training in 

four Irish companies to deteimine qualitative and evaluative measures. Summary Report 
A.5.1 Introduction 

This study is the Irish contribution and response to the call from the European 
Commission, Task Force Human Resources, Education, Training and Youth for a 
transnational study of evaluation and quality control in continuing training in small and 
medium sized enterprises. 

This sample study will provide an inventory of measures currently used in Ireland which 
will inform the wider study of training evaluation procedures and practices used in- 
company training across Europe. 

A.5.2 Quality assurance focus 

In selecting four companies which are undertaking training to implement quality 
assurance of their products and services it was possible to identify were parallels existed 
with the measures being undertaken by those companies to improve their products and 
services including the provision of training itself 

It is proposed that from the European survey that a transnational project in The Leonardo 
Programme could further define best practice in Europe and recommend procedures and 
practices including any iimovative measures. 

A. 5. 3 Evaulation focus 

The case studies provide evidence of the evaluation measures actually used in the 
companies studied. These are summarised in the report findings. 

A. 5. 4 Methodology 

The national and regional training awards wiimers are the focus of this desk study which 
attempts to filter out the qualitative and evaluative measures in each case. 

The study selected four competition entrants and utilised their application forms for the 
1993 awards to glean whatever information and insights transpired from each case. By 
using the same set of questions in each case the study attempts to establish the rationale 
and implementation of the training process from the stage of identification of training 
needs, through the training plan development, to the delivery process, and the transfer to 
the workplace. 

The study addresses how in each case evaluation was planned and carried out and the 
areas of concern and focus in each case study. 

Two instruments were used by the study, the National Training Award application form 
(Appendix 1) and a form devised for this study using the European Commissions Task 
Force -suggested key questions- (Appendix 2). A matrix was prepared from the second 
form to aid synthesis. 

A.5.5 Summary Findings 

Quality Assurance is no longer a -nice to have- feature in the marketplace but a 
requirement if companies are to continue to trade in the markets of an expanded Europe 
and worldwide. Quality procedures manuals provide the baseline from which any element 
can be evaluated on a micro level. 

Good evaluation requires accurate reliable information; quality assurance systems provide 
much more information than was previously available to the training function. 

The value of training and the training function as a tool for competitivness is constantly 
underlinded in this study. The focus on participation and cross-functional project groups 
to achieve corporate aims is significant and raises the profile of the training function in 
its role as a change agent and a means of attitude development in an enterprise. 

The key function of the accurate identification of training needs and training design is to 
specify in outcome terms what behavioral changes are required. Deciding how the 
outcome will be measured at the outset is the key to effective training intervention and 
evaluation. 
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Quality assurance accreditation and the certification of training providers is now taking 
place and is a logical development; it will be used more to aid vendor ratings in the 
competition between training and education providers to industry. 

A common theme runs through these case studies. It is that the development of staff, plus 
increased employee involvement and customer focus in all aspects of a business are keys 
to quality and competitiveness. 

A.5.6 Recommendations 

That a standards specification for training should be included in the ISO 9000 series for 
initial and continuing training of workers and management in industry and business. 
The specification should include minimmn standards for the following: 

4 Identification of training needs, approved methods and instruments. 

5 Training programme specification including model instruments and a section for the 
specification of personnel involved in hiunan resource provision. 

6 Evaluation and quality assurance instruments, including transfer to workplace 
measurement, financial benefit indicator instruments, assessment and certification 
specification instruments. 
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A.6. Quality assurance study. National inventoiy for the Grand Duchy of Luxembuig - 
summaiy 

In Luxemburg, in the absence of any framework law, the statutory reference framework 
is constituted by the Law of 4 September 1990 reforming technical secondary education 
and continuing vocational training, which specifies die private and public bodies 
empowered to provide continuing vocational training. 

There is no obligation on employers to carry out in-house training. The Luxemburg 
government is in the course of establishing new, high-performance structures of direct 
value to continuing vocational training. 

The Economic and Social Council has drafted an opinion which lays the groundwork for 
a draft law that will lay down global regulation of the continuing vocational training 
market in Luxemburg, with particular reference to aspects relating to individual 
promotion, adult education and continuing vocational training. The Economic and Social 
Council expects to propose a framework law in this area during 1995-96. The questions 
raised essentially relate to the following problems: 

- the financing of continuing vocational training by firms, employees and the State 

- conditions of access to continuing vocational training for all men and women 

- the method of protecting the firms' investment in continuing vocational training 

- the certification of the training modules 

At present, it is the firms which finance the training of their employees. The public 
authorities finance retraining and refresher courses and general training, and co-finance 
the training initiatives undertaken by the professional Chambers and aimed at those for 
whom they are responsible. 

As regards financial incentive programmes, decisions are taken from case to case, with 
the intervention of various ministers (the Minister for National Eductional, the Minister 
for Economic Affairs and the Minister for Small Firms and Traders). In general terms, 
the Minister for National Education and Vocational Training has jurisdiction over CVT. 

As regards the selection of the various projects, among a sample of 50 firms selected for 
the study, the decision is based: 

- partly on the nature of the firms which undertook the various projects: 

- partly by way of in-house training, and 

- partly by way of training courses offered by public services or private bodies; 

- partly on the fact that the selected projects illustrate certain qualitative approaches, 
such as, for example: 

- instructional approach, 

- "made-to-measure" approach, 

- integration of training into a strategy of management by objectives. 
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- integration of training into a strategy of management by principles. 

As far as continuing training bodies are concerned, there is evidence of a general trend 
towards regarding continuing training as a strategic investment by firms in the skills of 
their human resources. 

Along these lines, more and more training bodies are proposing an approach which is 
tailored to the firms and covers, in particular, the aspects of needs analysis, the planning 
and implementation of training activities, and an evaluation of those activities. 

The essential aspect of quality assurance schemes is focused on the preparation and 
implementation of training schemes through complete, and indeed sophisticated, 
specifications, the establishment of coaching ^er the training courses, the integration of 
the participants in defining content, experimentation with new teaching techniques and 
the selection of those responsible for training. These activities are designed to ensure 
maximum substantive workplace transfer and highlight the absence of reliable evaluation 
tools which are both inexpensive and easy to employ. 

However, there is also evidence of a return to less elaborate specifications, the full 
versions being considered to be too weighty and/or too expensive as tools to meet the 
needs, and hence the objectives, of the client firms. 

The two cases of in-house training described are not representative of a quality assurance 
situation in continuing training in Luxemburg. In both the cases described, the needs to 
be met derive from a translation of the firms' operational and strategic objectives into 
plans of action which require clearly defined qualifications and so generate an approach 
whereby existing qualifications are adapted to the target qualifications though 
individualized training plans. In both these selected enterprises, the approach adopted 
comprises a specific definition of the objectives to be achieved through training, the 
preparation of ongoing control during the implementation of the scheme and, a posteriori, 
an evaluation of the results achieved. In both cases the training is clearly defined as an 
investment, and those responsible for training act as training consultants. 

However, the majority of firms are not yet at this stage of continuing vocational training 
management. Too often, the activities of the training departments are confined to mere 
"identification" of needs on the ground, with the establishment of training schemes that 
have no specific, quantifiable objectives or no relation to the firm's operational objectives, 
and the buying-in of training from an external body in an attempt to reconcile the 
identified needs as closely as possible with the needs covered by the services offered by 
bodies which are active in the market. 

Before stressing quality assurance concepts in continuing training, it is absolutely 
essential to generate awareness of the crucial importance of continuing training in the 
strategic management of human resources and so, ultimately, in the strategic management 
of the firm. 

In this context, the public arguments relating to the framework law of continuing 
vocational training and the stepping-up of the activities undertaken in order to make 
management personnel more aware of continuing training as an investment in the skills 
of their human resources will certainly help to change the views of the role of continuing 
vocational training held by the economic actors in the Grand Duchy and, a fortiori, the 
quality assurance measures which they adopt. 

We should note that, even in the present absence of this framework law, the social 
partners are more and more often including aspects of vocational training in their 
collective agreements. 
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A. 7. Summaiy of re^rt on 'K^uality assurance in CVT" [Portugal!] 

A.7.1 Context 

It is a matter for the Minister for Employment and Social Security and, within the 
ministry, the Secretariat of State for Employment and Vocational Training to define 
employment and vocational training policies. For this purpose, this Secretariat of State 
receives proposals from the Directorate-General for Employment and Vocational Training 
and from the Supervisory Body for Employment and Vocational Training. These policies 
are discussed with the social partners in the context of concerted social planning. 

The implementation of these policies is a matter, in the first instance, for the lEFP 
(Institute for Employment and Vocational Training). This body, which itself undertakes 
vocational training schemes, also plays an important part as a guarantor of the quality of 
vocational training undertaken throughout Portugal. 

For the implementation of the schemes as such, the lEFP uses its own network of 
vocational training centres (directly managed or co-managed by it). 

Again in the context of government bodies, vocational training is also arranged by various 
Ministers who control bodies which have jurisdiction to do so. 

It must also be emphasized that the firms are nearly all SMEs (about 98 %) who have 
some difficulties in obtaining access to vocational training. It is always the large firms 
that make most use of the existing finance. 

A. 7.2 Case studies 

In the cases described, we have tried to give as accurate an impression as possible of the 
various types of actors who have important parts to play in the field of training. 

- 1st case; Renault Portugese, Soc. Ind. e Com., SA 

This large multinational enterprise has a training structure and applies to its own 
vocational training schemes the international rules relating to their design, planning and 
execution. 

This enterprise also applies a policy of upgrading human resources, which is based on 
training. 

- 2nd case: Institute of Banking Training (IFB) 

As a training body of the Portugese Banks Association, the IFB is a body in the form of 
an association. 

In fact, it is the most representative body in the field of training for the banking sector, 
which sector is itself representative of the vocational training carried out in recent years. 

- 3rd case: Fund for the Development and Teaching of Engineering, Electrical 
Technology and Computer Technology (FUNDETEC) 

This Portugese group of firms is passing through a period of drastic restructuring, which 
is being reflected by a streamlining of its workforce. 



It has a training structure, which is also undergoing restructuring, and forms one of the 
major enterprises which are imdertaking vocational training schemes. It is appropriate to 
emphasize that virtually all enterprises in the group are certified as far as quality is 
concerned. 

- 4th case: PORTUCEL - Empresa de Celulose e Papel de Portugal, SA 

This foimdation was set up by various firms with a view to meeting vocational training 
requirements as regards new information technologies. It is a representative body in this 
field, which has the special feature of being associated with imiversities and firms. It 
offers its services in the field of training, especially to the associated firms but also to 
other firms, especially SMEs: 

- 5th case: Coopers & Lybrand (Portugal) 

This small firm, which has international links, offers consultancy services in the field of 
vocational training. Its portfolio of customers is divided between SMEs and larger firms. 

It is interesting to note that this enterprise has two types of priority as far as quality is 
concerned: quality of internal procedures and quality of services supplied externally. 

This public institution, which is legally independent, has at national level the function of 
implementing the employment and vocational training policies laid down by the 
government. To this end, it acts as a promoter of training schemes, supported by its 
operational network of vocational training centres. It also h^ the task of managing and 
supervising the training schemes carried out by those entities which apply for the . aid 
allocated to vocational training. Thus, this institution is doubly preoccupied with quality, 
as dictated by its fimction, which derives in particular from its supervisory role and its 
quality requirements with reference to other Portugese promoters. 



A.7.3 Conclusions 

A concern with quality assurance is a constant feature of all those involved in the system. 

Within the enterprises, the procedures are to some extent limited to the procedure of 

obtaining a certification of the firm imder ISO 9000. 

We believe that quality assurance has to be considered in the context of the overall 

training system, and in order to do this it is necessary to take action: 

- at the level of reconciling supply and demand, to ensure that the efficiency of training 
can be maximized. This relates to factors which generate synergistic effects and 
incentives, and hence result in cost optimization; 

- in the training process as such, with activities directed at the trainees, the instructors, 
methodologies, methods and other teaching resources, the quality of which has to be 
ensured, especially in the course of the evaluation process; 

- in the evaluation and control procedures, which are regarded as sources of feedback 
and the quality of which reflects the quality of the process itself; 

- in the functioning of the training market as such, in terms of the rules to be laid down, 
relations between "customers" and "service providers", and quality indicators which 
need to be selected for that purpose. 
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A.8 The Quality Guarantee in Continuing Training in Spain and Europe - Summaiy of 
the Spanish stu^ 

Among the Spanish professionals and responsibles of training, there is a wide interest and 
debate about the concept and necessity of quality guarantee in continuing training. In 
Spain, this is relatively new, not only in those aspects related to its framework and 
definition, but also in instrumentation and standardisation. 

The Continuing Training in industry has increased considerably in Spain. This important 
increase becomes apparent, not only by an increment in the expenses and investments 
budgets, the number of courses and programmes, the volume of training offer, etc., but 
also by the strategic focus of the Continuing Training in relation to enterprise objectives 
and its consideration as basic function for the organisation development and competitivity. 
In the framework of Force/Eurotecnet 1994 project about Quality Guarantee in Training 
which takes place in or for enterprises, the Spanish study pretends: 

7 to analyse this situation in Spain; 

to collect some illustrative cases of the most representative practices in matters related 
to quality in training; and 

8 to collect the worries, suggestions, trends and opinions of the different agents of The 
Continuing Training. 

A.8.1. Some Data About Continuing Training in Spain 

As in most of the countries, the Continuing Training in Spain is an organisational 
function, which develops in a wide framework of free iniciative and market. 

In Spain, there is few legislation related to Continuing Training. The main laws and 
norms are the following: the Labour Workers Statute (1980), the Basic Employment Law 
(1980), the Decret of Professional Training (1990), the National Programme of 
Professional Training (1993), and the National Agreement of Continuing Training. 
There is neither Spanish legislation about training quality, nor norms to which training 
departments or organisations which offer training programmes to enterprises and 
individuals should follow. To this respect, we can only mention the requirements 
established by INEM for the acknowledgement of the centres which run programmes of 
Continuing Training within the framework of FIP Plan, or the measures included in the 
calls of subsidies for Continuing Training of FORCEM about quality of the plans to 
subsidise. 

The different studies developed about the Continuing Training in Spain, show that 
processes of evaluation are increasingly included in training designs and implementation. 
However, it is not still stated, neither an approach oriented towards the establishment of 
-guarantees of quality-, nor a systematic evaluation of the training efficiency and 
profitability. Very often, the difficulty of the processes and the inadequacy of the 
available instruments explain this fact. 

A.8.2. Studied Cases 

It was elaborated a census of 120 institutions and companies from different sectors, 
regions and characteristics which have services or systems with a recognised development 
level. It was sent a survey to collect basic information about systems of quality and 
evaluation of training. The following six cases were selected with formal and operative 
systems of interest: 

AEEDE (Spanish Association of Business Administration Schools): AEEDE is an 
association made up by the eight most important and acknowledged business schools in 
Spain. The belonging to AEEDE gives its members recognition of their high level and 
quality of their training, in Spain and abroad. It has established criteria and standards, 
which current members or schools trying to enter to the Association should respect. 
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9 INEM (National Institute of Employment): The INEM develops its training activities 
in its centres and with its own resources, as well as through the recognised training 
centres. The study presents the criteria and procedures established for the regulation 
of centres, programmes and measures of non-presential training. 

10 INI-TENEO: TENEO is the largest holding of State Spanish companies. In order 
to coordinate the policies and criteria which guide the training plans of the 
corporation companies, it has established a system, presented in this study, to 
improve the quality levels and productivity of training. 

11 DRAGADOS AND CONSTRUCCIONES: It is the most important construction 
company in Spain. It has recently obtained the ISO 9000 Certificate of Quality. Its 
training system has been included as one of the procedures evaluated, and it has 
been considered fitting with the criteria and quality services procedures following 
ISO Standards. The study summarises the criteria and practices related to evaluation 
and following of training programmes. 

12 TELEFONICA OF SPAIN: Telefonica in the first Spanish company, with a very 
developed training system. Its model of evaluation and following of training, not 
only for its technical characteristics but also for its applications, helps to take 
decisions related to quality and the future development of training plans. 

13 DIRFO (Directory of Training): It gives training and human resources managers 
and professionals information about the Spanish training offer, and about its quality 
and characteristics. DIRFO has developed two quality systems: One based on the 
collection of their clients opinion about institutions contracted and their 
programmes, and another based on the measure of five variables: satisfaction 
effectiveness, profitability, suitability and trainers performance. 



A.8.3. Conclusions 

A.8.3.1 Necessity of valid references for training quality 

The training in Spain lacks of valid systems to face up to the quality in the continuing 
training. Every training department or organisation has its own system, more or less 
developed. At the same time, it is necessary to clarify the training market. During the last 
years, the training offer has largely increased in Spain, often with a very aggressive 
marketing, which makes difficult to choose the most suitable and of good quality 
programmes or services. 

A.8.3.2 Definition of die concepts of Guarantee-Quality-Training 

There is not a clear definition of these key concepts, so we will have to work in their 
definition: 

14 The training concept increasingly diversifies in self-training, learning organisation, 
teletraining, advise and consultancy, in-job-training, professional career 
development, diffuse education, and multiple strategies and activities which have 
as consequence the adquisition and development of professional and personal 
competencies. 

15 The concept of quality of training, referring, either to the processes, factors and 
people engaged in training, or to the results and competencies required to assure the 
effectiveness in the company productivity processes, or to the impact on the 
competitiveness and the economic results of the company. 

16 The concept of Guarantee must be clarified, in order to know if it can be related 
to the usual concept of guarantee (as it occurs with other products or services), with 
application of commitments, rules and conditions, or if it is only a psychological 
and wilful statement. 

A.8.3. 3 Controversy about certification and standardisation of training 

As in other countries, neither in Spain the certification of quality has been implemented 
in the training institutions. Will this situation be due to the fact that the professional 
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exercise is more comfortable without any established requirements? Is it convenient to 
hope that the market laws clarify training offer and classify training institutions following 
their quality and effectiveness? Don-t we take too many risks, meanwhile, wasting 
resources, frustrating expectations, damaging the training image? Is this task exclusive 
of individuals, alone or associated? Doesn-t it be the public powers task to establish or 
enhance the rules to protect consumers, promote the efficiency of the resources, 
estimulate the competitivity? Wouldn-t it be appropriate that the State, as it has a 
subsidiary function, should promote or support projects, related to these aspects, when 
they have not been developed by private initiatives? 
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A.9 Quality Assurance of In-Company Training - United Kingdom 
A.9.1 Case Stud^ One - Bowles Outdoor Centre 
A.9.1.1 Oiganisation Profile 

Bowles Outdoor Centre is a specialist provider of outdoor education, outdoor recreational 
activities, and personal development/management development and teambuilding courses 
using the outdoors. It has 16 employees. 

Five years ago the Centre focused wholly on the first two activities -outdoor education 
and recreation. Then the Centre anticipated that the demand for recreational services 
would start to decline and realised the importance of introducing another market sector. 
The Centre therefore made a positive decision to make a major strategic change of 
direction to become a provider of outdoor management and team-building activities. 
This involved a substantial change in emphasis. Existing staff were then outdoor 
specialists and had negligible experience in management development. New skills had to 
be learnt by the Centre-s staff such as training needs analysis and the ability to review 
performance of a team and relate the learning points to the working environment. 
Before the Centre could start the training process of its staff, a culture change was 
necessaty and a need to demonstrate to staff that different training approaches were possi- 
ble. This was achieved by a series of exchange opportunities which broadened staff-s 
perspective. 

The second stage was achieved through intensive training development reflecting the 
experiences that the Centre wished to offer corporate clients. The Centre-s staff also went 
on industrial secondments. In addition the staff were required to learn management theory 
and practice and develop classroom tutoring and reviewing skills. 

All staff studied for, and achieved, an Institute of Training and Personnel Development 
qualification. To achieve the qualification staff were assessed on their training skills on 
a ongoing basis in the working environment by external training providers. In addition 
internal co-tutoring enabled staff to monitor each others development and share their 
experiences. As part of the qualification the Centre-s staff were required to undertake an 
assignment which was presented to and assessed by external qualified management 
trainers. 

A.9.1.2 Quality Assurance 

At an early stage in the process of developing a strategic change in direction into 
management development training the Centre revised that quality assurance of tr ainin g 
activities would be vitally necessary. 

Quality assurance would prove to clients that a training activity which they might feel 
was peripheral did in fact have real benefits for the organisation. The Centre also felt that 
it would help them gain a market advantage in a very competitive market place. 

The first step the Centre took towards quality assurance was to pursue IS09000 part 1. 
The Centre believes that quality assurance in relation to management development courses 
means, first and foremost, understanding the needs of the client. Discussion takes place 
between the client and the Centre to establish as clearly as possible the needs of the team 
and the objectives of the training. Wherever possible this is done by a visit from one of 
the tutorial staff to the client-s premises. Ideally members of the team who are to attend 
the training event are interviewed during the visit. 

In writing objectives for a management development course the Centre asks the client to 
be as specific as possible about their training needs. Wherever possible the Centre 
encourages the client to use indicators which will enable them to measure changes as a 
result of the training programme. The use of performance measures provides an automatic 



evaluation system and brings it clearly home to participants that the course is about real 
and measurable change. 

The Centre believes that a one off training event is seldom very valuable without a link 
into an ongoing training process. In fact rather than viewing the event as training the 
Centre prefer to think of it as development, where each individual takes a clear 
responsibility for their own learning and takes it in whatever direction is individually 
appropriate. 

The Centre establishes the link with work at the very beginning of the any management 
development programme by the use of diagnostic questionnaires. Individuals are asked 
to formulate their own objectives in relation to the results of the questionnaire. 
Throughout the management development course reviews relate back to the working 
environment. 

At the end of the course an action plaiming process takes place in order to transfer the 
learning points back into the workplace. 

Follow up and evaluation then takes place a month or so after the end of the course. 
Ideally through a personal visit by the tutor to the workplace. The purpose of the visit is 
to discuss how action plans are progressing, to establish how effective and to what extent 
the training was in meeting the client-s needs, to evaluate the contribution of the 
Centre-s inputs and to evaluate performance improvements. If a personal visit is not 
possible then follow up is carried out through the use of a questionnaire to the client and 
the individual participants. 

A.9.2 Case Study Two: Qeveland Ambulance National Health Service Trust (NHS). 
A.9.2.1 Oi^ganisation Profile 

This case study is about the paramedic training undertaken by Cleveland Ambulance (CA) 
Service. In Britain national guidelines for the training of paramedic staff are laid down 
by the National Health Service-s Training Directorate (NHSTD). The nationally 
prescribed deadlines include a series of timeserving criteria. 

The Board of Directors of CA were particularly aware that time serving does not 
necessarily demonstrate competence. Many people who had served the required time were 
not capable of attaining the required standard, whilst many of those capable of attaining 
the required standard had not served the required time. 

Aware that National Vocational Qualifications (NVQ) were being developed for 
ambulance staff CA decided to develop its staff using the draft NVQ standards. CA 
agreed that the paramedic training would involve trainees undertaking four modules. 

A.9.2.2 Quality Assuring The Training 

Training for the first two modules is conducted by ambulance instructors. At the end of 
the training candidates are examined by appropriate hospital medical consultants using 
verbal and written tests and simulation activities. The examination of trainees by external 
parties ensures that the objectives and standards set for the training are being met. 
During the third module trainees are assessed on their competence through observation 
in a hospital environment by hospital staff in conjunction with ambulance instructors. The 
use of hospital staff in assessing a trainees competence in the working environment 
ensures that training objectives are being met. 

The fourth module uses work based training and assessment to demonstrate the trainees 
competency. At the beginning of this module trainees are assigned to work with a 
qualified paramedic, who is also qualified, through achieving the Training Development 
Lead Body standards, as a skills trainer/assessor. 

At the beginning of the module the trainee undertakes a self assessment examining the 
outcomes required to perform their job role and to grade themselves against each element. 
The trainee and trainer/assessor discuss the outcomes of the self assessment and agree 
an action plan which sets out how the identified training needs will be met, target dates 
for completion and the people who will be involved in the training. A record of training 
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activity is maintained and reviewed/ Documentary evidence recording details of a 
particular incident in which the trainee wishes to claim evidence of achievement and 
which the trainer/assessor has verified is also kept. 

The trainee and trainer/assessor work "with each other until such time that both feel that 
the trainee can provide sufficient evidence to demonstrate competency to a independent 
internal verifier. 

When a trainee has completed the competence based training programme and has been 
assessed and found competent they are -licensed- by the Cleveland Ambulance 
Paramedic Advisory Panel to practice as a paramedic. Once the NVQ has been accredited 
these staff will submit portfolios of evidence for the award of NVQ level IV in Paramedic 



A.9.3 Case Stutfy 3: Walker Financial Solutions Ltd. 

A.9.3.1 Oi]ganisation Profile 

Walker Financial Solutions Limited is a computer software house and systems 
consultancy, founded in 1985. It develops computer software primarily for financial 
applications, such as accounting and insurance broking systems. It employs 80 people. 

A.9.3.2 Training 

The organisation operates in the computer industry where skills are in short supply, and 
technology is rapidly changing. The nature of the organisation-s products and services 
require that employees have a high level of technical ability. 

By early 1988 the company was finding difficulty in recruiting skilled staff. Existing staff 
had too few specialist skills to adapt readily to rapidly changing project requirements. The 
company realised that training and development was needed at all levels to address these 
problems, and to enable the organisation to achieve increased profitability, efficiency and 
reduced staff turnover. 

In order to meet the organisational needs objectives were established at organisational 
level for the training and development activities. 

At the individual level it was decided to set standards and objectives prior to any training 
or development activity. Where possible all training was to be linked to certificates of 
competency and qualifications, including National Vocational Qualifications (NVQs). 

A variety of training methods are used to deliver the training. Training methods include 
training with external providers, structured on the Job assignments, workshops, open 
learning, and management development training in the outdoors. Open learning and self 
development is also encouraged. 

A.9.3.3 Quality Assurance 

All training activity is linked to measurable outcomes and to the achievement, where 
possible, of external standards of competency. 

Before any training or development activity, either internally provided or via an external 
supplier, the individual or group concerned would set a measurable objective(s) with their 
manager. They also discuss the purpose of the training or development activity. For the 
training or development activity to be authorised, a business benefit from the activity is 
identified and the measurable objective(s) set link into this. 

Following the training or development activity the manager and individual or group meet 
to assess whether the objectives have been achieved. Subsequent performance is assessed 
through observation by the individual-s line manager and self evaluation. 

All employees have a performance review every three months based on measurable 
objectives. During the reviews an evaluation takes place to establish the degree of 
business benefit achieved through previous training or development activities. Evaluation 
results are recorded on employee training records and areas for improvement are noted. 
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Every six months in a interactive process between employee and line manager Ae em- 
ployee-s Personal Development Plan is reviewed and the need for further training and 
development activities are discussed and agreed. 

Training suppliers are chosen via a supplier selection procedure, which determines their 
ability to meet defined objectives for training. After the training, employees are asked to, 
complete a questionnaire evaluating the training provider. TTie performance of Ae 
provider is also assessed through the debriefing process after the training activity, which 
determines how successful the training was in meeting pre course objectives and business 
benefit. 

All training analysis and evaluation processes have been placed with the company Quality 
system and ISO 9000, strengthening the quality assurance of training. 

A.9.3.4 Benefits 

The effects of the training on the organisation has been to fully address the problems of 
sldll shortages. With all staff having undertaken training the company has a highly 
flexible multi-skilled workforce. 

Training has also resulted in clear succession planning. Individuals are identified to 
•assume management positions and all staff realising clear career development paths. 

A.9.4 Case Study 4: Training Provider (Norfli Traffonl College) and Qient/Enteiprise 
(Ha^'s Chemical Distribution Ltd.) 

A.9.4.1 Oiganisation Profile 

North Trafford College, Manchester specialises in the delivery of general, vocational and 
customised programmes of training to Industry, Commerce and Commumty on a local, 
national and international basis. The College has achieved ISO 9000. 

Hays Chemical Distribution Ltd, Sandbach, is a medium sized manufacturing enterprise 
producing bulking organic chemicals.The company is currently certified under ISO 9000. 

A.9.4.2 Training 

This case study is about the implementation of NVQs in Process Operations (Chemical 
Industries Association (CIA) Scheme) at Hays. Training is provided on site at Hays by 
North Trafford College specialists. The training is delivered toough tutor supported open 
learning materials developed by the College for Assessor Training. 

Choosing North Trafford College as a Provider: The college initially came to Hays 
attention through recommendation by the CIA, the Industry Lead Body and Employers 
Association. Discussions took place by telephone, letter and in person between senior 
college and company personnel in order to determine needs, define training programmes 
and estimate costs. 

Determination of Training Needs: Overall, Company training needs are dictated by 
strategic policies and the hisiness plan. Training needs are determined on an individual 
and corporate basis. Individixal needs are identified at the recruitment and induction stages 
through the annual cycle of appraisal. These formal systems are supported informally 
through the line management structure and day to day operational contact. 

The Company operates a long standing internal protocol in the assurance of competence. 
Each section of the operator-s job is subdivided into a list of composite tasks, recorded 
in the form of a competence check sheet. Before an operator is allowed to work 
unsupervised, competence of each task is confirmed and each item on the check sheet 
-signed off- by a shift manager-foreman. The manager confirms the operator-s 
competence through observation and questioning. If the operator is found not to be 
competent in a task, training is given. A complete training record is retained for each 
employee. 



Check-sheet confirmation is also employed .when operational aspects of the task change. 
The check-sheet can also be used as a reminder when the operator has not performed die 
task for some time. 

The company made the decision to implement National Vocational Qualifications for 
Process Operators in the company. 

A.9.4.3 Quality Assurance 

Assurance of quality in training is performed by the College and the Company in 
partnership. Measures are taken by both and independently. 

Quality Assurance Measures: Training is organised through the Personnel Department 
under the auspices of the Personnel Manager. A Company mentor is allocated to each 
trainee. The mentor supports the trainee through out the programme, monitors progress, 
quality of delivery etc to the Personnel Manager. Mentors and The Personnel manager 
review the quality and progress of training formally on a monthly basis and more fre- 
quently informally. The Personnel Manager supports trainees through a scheduled contact 
framework supplemented where needed by additional meetings. Company culture and 
philosophy facilitates further support to the trainee through open access to in-house 
expertise. The practise of mutual support and cascading of expertise is well established 
and genuine interest in the development of personnel is displayed by all levels of 
management. 

College trainers discuss matters of quality and progress with the personnel manager, 
mentors and students frequently. Feedback between trainer and trainee is continuous. The 
Company provides a full compliment of resources to support trainees e.g. training 
facilities, text books/ work manuals, stationery etc in order to help make the learning as 
barrier free as possible. Tutor marked assignments are channelled through the Personnel 
Manager to trainees. In this way, progress is further monitored, deadlines adhered to and 
extra help provided if needed. Counselling, to combat the fear of learning often 
experienced in mature trainees long past compulsory and initial formal education, is 
provided by both tutors and the Personnel Manager. 

Throughout the training programme skills and Imowledge are tested and confirmed by 
tutors and through the company system of skill check-sheet completion. 

During the life of each training programme. Quality Assurance questionnaires are 
completed by company personnel and returned to the college. Any areas for improvement 
identified by the questionnaires are actioned. 

Senior college personnel maintain regular personal contact with the company. This liaison 
supports the Quality Assurance function and also alerts the college to possibilities to ten- 
der for future provision of training. 

At the college, specialist trainers are managed directly by a Section Leader who, in turn, 
reports to the Director of Faculty. Section Team Meetings are held weekly to ensure that 
quality issues receive high priority. In addition. Section Leaders review and discuss 
progress with the Director of Faculty each week. Where needed, feedback between all 
personnel is arranged. 

At the end of each training programme a comprehensive process of -Course Review- is 
undertaken. The process explores all aspects of the programme, judges summative success 
and leads to the formation of an action plan for the future. Company feedback forms an 
integral part of the review process. 

Outcomes of Training: The major effect is the acquisition of a trained, competent 
workforce. Qualification successes have remained high and progress on target. 

17 For the Company: Intrinsic changes in attitude have been noted and often led to the 
desire in the workforce to continue to learn. Trainees want to progress to higher 
levels of qualification and maximise their potential. Failure has been reduced e.g. 
plant is operated more productively. Employees show greater interest in performing 
their work. 

18 For the College: Pleasure and satisfaction gained through success and through 
securing success in others is a great motivator for trainers. The close relationship 



with the Company provides mutual knowledge of culture, needs and understanding. 
Success breeds success and helps to ensure the future of the College service. 
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